Big Data Analytics
Microsoft deepens its commitment to Apache Hadoop and open source analytics – Last week, Hortonworks hosted the DataWorks Summit in San Jose, California, which is billed as the world’s premier big data community event for everything data. This post provides a rollup of Azure HDInsight info and reflects on the progress made since the start of Microsoft’s partnership with Hortonworks and contributions made to Apache projects, such as Hadoop, Kafka, and Spark. More details are also available in the four posts listed below.
Top 8 reasons to choose Azure HDInsight – Learn the top eight reasons why enterprises such as Adobe, Jet, ASOS, Schneider Electric, and Milliman are choosing Azure HDInsight for their big data applications.
Azure Data ingestion made easier with Azure Data Factory’s Copy Data Tool – The Copy Data Tool sets up a pipeline to accomplish the data loading task in minutes, without having to understand or explicitly set up Linked Services and datasets for source and destination. Now, it supports all 70+ on-prem and cloud data sources, and we will continue to add more connectors in the coming months.
Event trigger based data integration with Azure Data Factory – This post announces support
Now in preview
Azure Blob Storage lifecycle management in public preview – Both Blob-Level Tiering and Archive Storage help you optimize storage performance and cost. Blob-Level Tiering enables you to transition blobs between the Hot, Cool, and Archive tiers without moving data between accounts. In response to customer feedback, you can now automate blob tiering and retention with lifecycle management policies. Azure Blob Storage lifecycle management offers a rich, rule-based policy which you can use to transition your data to the best access tier and to expire data at the end of its lifecycle.
Exciting advances in Azure Alerts – From better alert management to Smart Groups – Three new features in Azure Monitor enable you to enumerate alerts at scale across log, metric or activity log alerts, filter alerts across subscriptions, manage alert states, look at alert instance specific details, and troubleshoot issues faster using SmartGroups that automatically group related alerts. Observe alerts across Azure deployments with the new alert enumeration experience and API. Change the state of an alert to reflect the current situation of the issue in their environment with Alert state management. To reduce alert noise and help in mitigating events faster, Smart Groups encapsulate mutliple
Featuring Infrastructure-as-a-Service on Azure
Why you should bet on Azure for your infrastructure needs, today and in the future – We are committed to providing the right infrastructure for every workload. Across our 50 Azure regions, you can pick from a broad array of virtual machines with varying CPU, GPU, Memory and disk configurations for your application needs. In this post on the Azure blog, Corey Sanders, Corporate Vice President, Azure, shares a few key reasons you should bet on Azure for your infrastructure needs and announces some new capabilities. In addition, these blog posts expand on items covered in Corey’s post:
(Preview) Standard SSD Disks for Azure Virtual machine workloads – Azure Standard SSD Managed Disks, a new type of durable storage for Microsoft Azure Virtual machines, is now available in preview. Azure Standard SSDs provide consistent performance for low IOPS workloads and deliver better availability and latency compared to HDD Disks. Azure Standard SSDs are also a cost-effective Managed Disk solution optimized for dev-test and entry-level production applications requiring consistent latency. Microsoft Azure Stack expands availability to 92 countries – We are expanding the geographical coverage of Azure Stack to meet the growing demand of the customers globally.
Microsoft + GitHub = Empowering Developers – Before we can take a look at what’s happened in Azure in the past week, be sure to check out this exciting news about an agreement for Microsoft to acquire GitHub. GitHub&emdash;home to more than 85 million code repositories&emdash;will retain its developer-first ethos, operate independently and remain an open platform.
Now in preview
VNet service endpoints for Azure database services for MySQL and PostgreSQL in preview – You can use virtual network service endpoints to isolate connectivity to your logical server from only a subnet or a set of subnets within your virtual network. The traffic to Azure Database for MySQL and PostgreSQL from your virtual network always stays within the Azure backbone network. Preference for this direct route is over any specific routes that take internet traffic through virtual appliances or on-premises.
Using VNet service endpoints for subnet-to-subnet connectivity
Receiving and handling HTTP requests anywhere with the Azure Relay – Azure Relay is a part of the messaging services family along with Azure Service Bus, Azure Event Hubs, and Azure Event Grid. It provides the “networking magic” that enables the Visual Studio Live Share. Relay now also supports relayed HTTP requests
Microsoft continues to be a leader in Gartner’s Cloud IaaS MQ – For the fifth consecutive year, Microsoft is recognized as a leader in Gartner’s IaaS Magic Quadrent. Check out this post for the details and a link to not only this report, but a long list of other Gartner MQs that place Microsoft in the leader’s quadrant.
Now in preview
Create enterprise subscription experience in Azure portal public preview – Learn about the public preview of a fully-integrated create subscription experience in the Azure portal for Azure Enterprise Agreement (EA) subscriptions. Previously, EA subscriptions were created in a separate EA portal.
Azure AD Authentication for Azure Storage now in public preview – This post announces the preview of Azure AD Authentication for Azure Blobs and Queues, which is one of the features most requested by enterprise customers looking to simplify how they control access to their data as part of their security or compliance needs. It is available in all public regions of Azure.
Azure AD Authentication for Azure Storage
Now generally available
New capabilities to enable robust GDPR compliance – If you haven’t checked your inbox lately, May 25th marked the beginning of enforcement of the EU
Azure the cloud for all – highlights from Microsoft BUILD 2018 – In this final recap of Microsoft Build 2018, Julia White, Corporate Vice President, Microsoft Azure pulled together some key highlights and top sessions to watch. This post summarizes what’s new across tools, containers+serverless, IoT, and Data+AI.
“Hey! You! Get on my cloud.” Corey Sanders at Build 2018.
Now in preview
Public preview: Query across applications in log alerts – You can use Azure Application Insights to monitor a distributed modern cloud application. In the same spirit, log alerts enable you to combine data across various apps. Cross-app query support in log alerts is currently in preview.
Now generally available
Protect virtual machines across different subscriptions with Azure Security Center – Azure Security Center’s Cross-Subscription Workspace Selection enables you to collect and monitor data in one location from virtual machines that run in different workspaces, subscriptions, and run queries across them.
Announcing SQL Advanced Threat Protection (ATP) and SQL Vulnerability Assessment general availability – SQL Vulnerability Assessment (VA) provides you a one-stop-shop to discover, track and remediate potential database vulnerabilities. It helps give you visibility into your security state, and includes actionable steps to investigate, manage and resolve
Last week, thousands of developers gathered in Seattle for Microsoft Build 2018, Microsoft’s annual developer conference, to learn how we are empowering them to advance the future of society with AI and the intelligent edge. This week’s Azure.Source covers a lot of content. For a more concise (TL;DR) summary of Build 2018, check out the Microsoft press release, Microsoft Build highlights new opportunity for developers, at the edge and in the cloud. For a roll-up of all the Azure announcements, see: Azure Announcements from Microsoft Build. And if you want to dig into all of the content delivered at Build 2018 session-by-session, you can now do so at Microsoft Build Live 2018.
New Azure innovations are helping developers write code today for tomorrow’s technology challenges – Scott Guthrie’s technology keynote at Build 2018 focused on the key areas of new Azure innovation that enable the intelligent cloud and intelligent edge – spanning developer tools, DevOps, containers, serverless, Internet of Things (IoT), and artificial intelligence (AI).
Technology Keynote: Microsoft Azure – Watch the keynote to see how we are helping every developer be an AI developer on Azure. Learn about and see demos of
Microsoft Build 2018 is just a few days away on May 7-9. Whether you can’t make it to Seattle or you just want to enhance your on-the-ground experience at the event, Microsoft Build Live brings you live as well as on-demand access to three days of inspiring speakers, spirited discussions, and virtual networking. The livestream gives you another way to connect, spark ideas, and deepen your engagement with the latest ideas in the cloud, AI, mixed reality, and more.
Now in preview
Python, Node.js, Go client libraries for Azure Event Hubs in public preview – Azure Event Hubs is expanding its ecosystem to support more languages. Azure Event Hubs is a highly scalable data-streaming platform processing millions of events per second. Event Hubs uses Advanced Message Queuing Protocol (AMQP 1.0) to enable interoperability and compatibility across platforms. Now, you can easily get started with Event Hubs with the addition of new client libraries for Go, Python, and Node.js in public preview.
Monitor Microsoft peering in ExpressRoute with Network Performance Monitor – public preview – Connectivity to Microsoft online services (Office 365, Dynamics 365, and Azure PaaS services) is through the Microsoft peering. We enable bi-directional connectivity between your WAN and
Microsoft Build 2018 is only a short week away on May 7-9. Whether you can’t make it to Seattle or you just want to enhance your on-the-ground experience at the event, Microsoft Build Live brings you live as well as on-demand access to three days of inspiring speakers, spirited discussions, and virtual networking. The livestream gives you another way to connect, spark ideas, and deepen your engagement with the latest ideas in the cloud, AI, mixed reality, and more.
Now in preview
How Azure Security Center helps detect attacks against your Linux machines – Azure Security Center (ASC) is now extending its Linux threat detection preview program, both on cloud and on-premise. New capabilities include detection of suspicious processes, suspect login attempts, and anomalous kernel module loads. Security Center is using auditd for collecting machines’ events, which is one of the most common frameworks for auditing on Linux. Any Linux machine that runs auditd by default and is covered by Security Center will benefit from this public preview. This post will also walk you through an example of detection analytics in action in the form of malicious crypto coin mining. It also includes some tips on using Azure Log Analytics
Azure Security News at RSA Conference 2018
Last week, we made several Azure Security announcements in conjunction with RSA Conference 2018 in San Francisco:
Introducing Microsoft Azure Sphere: Secure and power the intelligent edge – Microsoft Azure Sphere is a new solution for creating highly-secured, Internet-connected microcontroller (MCU) devices. Azure Sphere includes three components that work together to protect and power devices at the intelligent edge: Azure Sphere certified microcontrollers (MCUs), Azure Sphere OS, and Azure Sphere Security Service.
Microsoft Azure Sphere Leadership Vision – Microsoft product and business leaders introduce Azure Sphere, the latest IoT offering from Microsoft that extends security and new consumer experiences to a whole new class of devices at the intelligent edge.
The 3 ways Azure improves your security – Learn how Azure provides value in three key areas – a secure foundation that is provided by Microsoft, built-in security controls to help you quickly configure security across the full-stack, and unique intelligence at cloud scale to help you safeguard data and respond to threats in real-time. Announcing new Azure Security Center capabilities at RSA 2018 – Azure Security Center provides centralized visibility of the