Author : All posts by ilikesql

20

Jun

Microsoft deepens its commitment to Apache Hadoop and open source analytics

DATAWORKS SUMMIT, SAN JOSE, Calif., June 18, 2018 – Earlier today, the Microsoft Corporation deepened its commitment to the Apache Hadoop ecosystem and its partnership with Hortonworks that has brought the best of Apache Hadoop and the open source big data analytics to the Cloud. Since the start of the partnership nearly six years ago, hundreds of the largest enterprises have chosen to use Azure HDInsight and Hortonworks to run Hadoop, Spark and other Open Source analytics workloads on Azure. Also, during this time, Microsoft has become one of the leading committers to Apache projects, sharing its experience running one of largest data lakes on the planet, with the open source community.

Azure HDInsight

Azure HDInsight is a fully managed cluster service that enables customers to process and gain insights from massive amounts of data using Hadoop, Spark, Hive, HBase, Kafka, Storm and distributed R. Azure HDInsight offers the latest Hortonworks Data Platform (HDP) distribution and related Open Source projects on the Linux OS. The service is available in 26 public regions and Azure Government Clouds in the US and Germany.
 
The Big Data and Hadoop community has rapidly evolved over the past few years. Azure HDInsight has supported

20

Jun

Microsoft deepens its commitment to Apache Hadoop and open source analytics

DATAWORKS SUMMIT, SAN JOSE, Calif., June 18, 2018 – Earlier today, the Microsoft Corporation deepened its commitment to the Apache Hadoop ecosystem and its partnership with Hortonworks that has brought the best of Apache Hadoop and the open source big data analytics to the Cloud. Since the start of the partnership nearly six years ago, hundreds of the largest enterprises have chosen to use Azure HDInsight and Hortonworks to run Hadoop, Spark and other Open Source analytics workloads on Azure. Also, during this time, Microsoft has become one of the leading committers to Apache projects, sharing its experience running one of largest data lakes on the planet, with the open source community.

Azure HDInsight

Azure HDInsight is a fully managed cluster service that enables customers to process and gain insights from massive amounts of data using Hadoop, Spark, Hive, HBase, Kafka, Storm and distributed R. Azure HDInsight offers the latest Hortonworks Data Platform (HDP) distribution and related Open Source projects on the Linux OS. The service is available in 26 public regions and Azure Government Clouds in the US and Germany.
 
The Big Data and Hadoop community has rapidly evolved over the past few years. Azure HDInsight has supported

20

Jun

Traffic Analytics now generally available
Traffic Analytics now generally available

We are excited to announce the general availability (GA) of the Traffic Analytics, a SaaS solution that provides visibility into user and application traffic on your cloud networks.

Since the public preview, three months ago, the solution has analyzed several terabytes of Flow logs on a regular basis for network activity across virtual subnets, VNets, Azure data center regions and VPNs, and provided actionable insights that helped our customers:

Audit their networks and root out shadow-IT and non-compliant workloads. Optimize the placement of their workloads and improve the user experience for their end users. Detect security issues and improve application and data security. Reduce costs and right size their deployments by eliminating the issue of over-provisioning or under-utilization. Gain visibility into their public cloud networks spanning multiple Azure regions across numerous subscriptions.

This GA release includes enhancements that help you detect issues and secure/optimize your network, faster and more intuitively than before.

Some of the enhancements in this release are:

Your environment: Provides a view into your entire Azure network, identifies inactive regions, virtual networks, and subnets – for example, network locations with VMs and no network activity for further analysis. Detects malicious flows as they flow across application gateways,

20

Jun

Traffic Analytics now generally available
Traffic Analytics now generally available

We are excited to announce the general availability (GA) of the Traffic Analytics, a SaaS solution that provides visibility into user and application traffic on your cloud networks.

Since the public preview, three months ago, the solution has analyzed several terabytes of Flow logs on a regular basis for network activity across virtual subnets, VNets, Azure data center regions and VPNs, and provided actionable insights that helped our customers:

Audit their networks and root out shadow-IT and non-compliant workloads. Optimize the placement of their workloads and improve the user experience for their end users. Detect security issues and improve application and data security. Reduce costs and right size their deployments by eliminating the issue of over-provisioning or under-utilization. Gain visibility into their public cloud networks spanning multiple Azure regions across numerous subscriptions.

This GA release includes enhancements that help you detect issues and secure/optimize your network, faster and more intuitively than before.

Some of the enhancements in this release are:

Your environment: Provides a view into your entire Azure network, identifies inactive regions, virtual networks, and subnets – for example, network locations with VMs and no network activity for further analysis. Detects malicious flows as they flow across application gateways,

20

Jun

Azure Event Hubs is now offering support for Availability Zones in preview

Azure Event Hubs makes streaming data effortless because of its simplicity and ability to scale easily. The sheer volume of data that goes through the Event Hubs platform is a testament to how reliable the service is. In fact, by the time you finish reading this sentence, Event Hubs will have ingested over 100 million events globally.

Today, we are adding to the durability of the service and offering support for Availability Zones in public preview for Standard Event Hubs. This new feature adds even greater resiliency and fault tolerance to the top event streaming service. Support for Availability Zones partners nicely with our disaster recovery feature to offer a highly available service that can withstand both a zone outage and a regional one when both are properly utilized.

Event Hubs has customers in Retail, Auto, Finance, and other verticals that use its streaming capabilities for scenarios such as predictive analytics and financial trading. Availability Zones support further enhances our commitment to keeping our customers’ workloads running as smoothly as possible. We hope you try out this new feature.

What regions will this be offered in? Central US East US 2 France Central

We’ll be offering support for additional Availability

20

Jun

Azure Event Hubs is now offering support for Availability Zones in preview

Azure Event Hubs makes streaming data effortless because of its simplicity and ability to scale easily. The sheer volume of data that goes through the Event Hubs platform is a testament to how reliable the service is. In fact, by the time you finish reading this sentence, Event Hubs will have ingested over 100 million events globally.

Today, we are adding to the durability of the service and offering support for Availability Zones in public preview for Standard Event Hubs. This new feature adds even greater resiliency and fault tolerance to the top event streaming service. Support for Availability Zones partners nicely with our disaster recovery feature to offer a highly available service that can withstand both a zone outage and a regional one when both are properly utilized.

Event Hubs has customers in Retail, Auto, Finance, and other verticals that use its streaming capabilities for scenarios such as predictive analytics and financial trading. Availability Zones support further enhances our commitment to keeping our customers’ workloads running as smoothly as possible. We hope you try out this new feature.

What regions will this be offered? Central US East US 2 France Central

We’ll be offering support for additional Availability Zones

20

Jun

Azure Service Bus is now offering support for Availability Zones in preview

Azure Availability Zones support for Service Bus Premium provides an industry-leading, financially-backed SLA with fault-isolated locations within an Azure region, providing redundant power, cooling, and networking. This preview begins with Central US, East US 2, and France Central.

This feature adds even more resiliency and fault tolerance capabilities to organizations in Finance, Healthcare, Retail, or other verticals that handle sensitive mission-critical data and transactions that simply cannot be lost or significantly impacted when using cloud messaging services.

Also, support for Availability Zones (AZ) combined with disaster recovery features offers high availability and fault tolerance that can withstand zone and regional outages.

Availability Zone support for Service Bus takes another step in the direction of keeping to our commitments in making sure customer cloud messaging between applications and services run as smoothly as possible. 

What regions will this be offered in during preview? Central US East US 2 France Central

Support for additional regions will be offered soon. Learn more about Availability Zones.  

How can you enable AZ on your Service Bus premium namespace?

You can enable Availability Zones on new namespaces only, we do not support migration of existing namespaces. 

If using an ARM template to create a Service Bus

20

Jun

Azure Service Bus is now offering support for Availability Zones in preview

Azure Availability Zones support for Service Bus Premium provides an industry-leading, financially-backed SLA with fault-isolated locations within an Azure region, providing redundant power, cooling, and networking. This preview begins with Central US, East US 2, and France Central.

This feature adds even more resiliency and fault tolerance capabilities to organizations in Finance, Healthcare, Retail, or other verticals that handle sensitive mission-critical data and transactions that simply cannot be lost or significantly impacted when using cloud messaging services.

Also, support for Availability Zones (AZ) combined with disaster recovery features offers high availability and fault tolerance that can withstand zone and regional outages.

Availability Zone support for Service Bus takes another step in the direction of keeping to our commitments in making sure customer cloud messaging between applications and services run as smoothly as possible. 

What regions will this be offered in during preview? Central US East US 2 France Central

Support for additional regions will be offered soon. Learn more about Availability Zones.  

How can you enable AZ on your Service Bus premium namespace?

You can enable Availability Zones on new namespaces only, we do not support migration of existing namespaces. 

If using an ARM template to create a Service Bus

20

Jun

Column-Level Security is now supported in Azure SQL Data Warehouse

Today we’re announcing Column-Level Security (CLS) for Azure SQL Data Warehouse, an additional capability for managing security for sensitive data. Azure SQL Data Warehouse is a fast, flexible and secure cloud data warehouse tuned for running complex queries fast and across petabytes of data.

As you move data to the cloud, securing your data assets is critical to building trust with your customers and partners. With the introduction of CLS, you can adjust permissions to view sensitive data by limiting user access to specific columns in your tables without having to redesign your data warehouse. This simplifies the overall security implementation as the access restriction logic is located in the database tier itself rather than away from the data in another application. CLS eliminates the need to introduce views to filter out columns for access control management.

Some examples of how this is being used today:

A financial services firm allows only account managers to have access to customer social security numbers (SSN), phone numbers, and other personally identifiable information (PII). A health care provider allows only doctors and nurses to have access to sensitive medical records while not allowing members of the billing department to view this data.

20

Jun

Column-Level Security is now supported in Azure SQL Data Warehouse

Today we’re announcing Column-Level Security (CLS) for Azure SQL Data Warehouse, an additional capability for managing security for sensitive data. Azure SQL Data Warehouse is a fast, flexible and secure cloud data warehouse tuned for running complex queries fast and across petabytes of data.

As you move data to the cloud, securing your data assets is critical to building trust with your customers and partners. With the introduction of CLS, you can adjust permissions to view sensitive data by limiting user access to specific columns in your tables without having to redesign your data warehouse. This simplifies the overall security implementation as the access restriction logic is located in the database tier itself rather than away from the data in another application. CLS eliminates the need to introduce views to filter out columns for access control management.

Some examples of how this is being used today:

A financial services firm allows only account managers to have access to customer social security numbers (SSN), phone numbers, and other personally identifiable information (PII). A health care provider allows only doctors and nurses to have access to sensitive medical records while not allowing members of the billing department to view this data.