Category Archives : Updates

14

May

10 great things about Kafka on HDInsight
10 great things about Kafka on HDInsight

Kafka on HDInsight is Microsoft Azure’s managed Kafka cluster offering. It has generated huge customer interest and excitement since its general availability in December 2017.

Here are 10 great things about it:

1. Enterprise grade Kafka

HDInsight Kafka is an enterprise-grade managed cluster service giving you a 99.9 percent SLA. We take care of the heavy lifting for you, including operations, monitoring, security patching, and more. Running some of the largest Kafka clusters on the planet, we have the expertise and knowledge to prevent and quickly fix any issues.

2. Up and running in minutes

Create a full cluster in minutes, not days. Traditionally, it takes weeks to provision your own Kafka cluster on premises or on IaaS. With HDInsight, you get your own dedicated Kafka cluster within a few clicks.

3. Real open-source Kafka

With HDInsight, you get the true Apache Kafka engine running on your clusters with all its functionality. People love Kafka for its high throughput, lowest latency and cost-efficient scale. Along with the Producer and Consumer APIs, Kafka also has a rich feature set, such as compression of messages for an even higher throughput, configurable retention policy (including retention beyond 7 days and size based

Share

10

May

Extract management insights from SQL Data Warehouse with SQL Operations Studio

SQL Operations Studio can be leveraged with Azure SQL Data Warehouse (SQL DW) to create rich customizable dashboard widgets surfacing insights to your data warehouse. This unlocks key scenarios around managing and tuning your data warehouse to ensure it is optimized for consistent performance. Previously, developers had to manually and continuously execute complex DMV queries to extract insights from their data warehouse. This leads to a repetitious process when following development and tuning best practices with SQL DW. Now with SQL Operations Studio, customized insight widgets can be embedded directly within the query tool enabling you to seamlessly monitor and troubleshoot issues with your data warehouse.

The following widgets can be generated by using the provided T-SQL monitoring scripts within SQL Operations Studio for common data warehouse insights.

Data Skew

Detect data skew across distributions to help identify and troubleshoot query performance issues:

Columnstore health and statistics

Leverage views to help maximize columnstore row group quality and ensure table statistics are up to date for optimal query performance:

User Activity

Identify and understand workload patterns through active sessions queries, queued queries, loads, and backups:

Resource Bottlenecks

Ensure adequate resources are allocated such as memory and TempDB:

Share

10

May

Enhancements in Application Insights Profiler and Snapshot Debugger

We are pleased to announce a series of improvements on Application Insights Profiler and Snapshot Debugger. Profiler identifies the line of code that slowed down the web app performance under load. Snapshot Debugger captures runtime exception call stack and local variables to identify the issue in code. To ensure users can easily and conveniently use the tools, we delivered the following new features for Profiler and Snapshot Debugger:

Application Insights enablement with Profiler and Snapshot Debugger

With the newly enhanced Application Insights enablement experience, Profiler and Snapshot Debugger are default options to be turned on with Application Insights.

Enabling Snapshot Debugger without redeploy your web app: For ASP.NET core web app, snapshot debugger is a simple, default option when enabling App Insights. It used to require modifying the project to install NuGet and add exception tracking code. Now it’s done via an ASP.NET core hosting light up through an App Setting, no redeploy will be required. ASP.NET support will be available very soon.

Enabling Profiler with Application Insights in one step: Enabling Profiler used to be done in a separate Profiler Configuration pane, which requires extra steps. This is no longer needed.

Profiler

On-demand profiler: Triggering a

Share

09

May

Announcing new Async Java SDK for Azure #CosmosDB
Announcing new Async Java SDK for Azure #CosmosDB

We’re excited to announce a new asynchronous Java SDK for Cosmos DB’s SQL API open sourced on GitHub. This SDK leverages the popular RxJava library to add a new async API surface area for composing event-based programs with observable sequences. It also features an improved user experience and is also lighter weight than our previous synchronous Java SDK (yielding a 2x performance improvement on the client-side)!

You can add the library from Maven using:

<dependency> <groupId>com.microsoft.azure</groupId> <artifactId>azure-cosmosdb</artifactId> <version>1.0.1</version> </dependency> Connect to Cosmos DB

The new SDK uses convenient builder pattern to specify connectivity options:

asyncClient = new AsyncDocumentClient.Builder() .withServiceEndpoint(HOST) .withMasterKey(MASTER_KEY) .withConnectionPolicy(ConnectionPolicy.GetDefault()) .withConsistencyLevel(ConsistencyLevel.Eventual) .build(); Insert an item

To execute and coordinate Cosmos DB data operations asynchronously, and get the results you use observables:

Document doc = new Document(String.format(“{ ‘id’: ‘doc%d’, ‘counter’: ‘%d’}”, 1, 1)); Observable<ResourceResponse<Document>> createDocumentObservable = asyncClient.createDocument(collectionLink, doc, null, false); createDocumentObservable .single() // we know there will be one response .subscribe(documentResourceResponse -> { System.out.println(documentResourceResponse.getRequestCharge()); });

Note that the createDocument request will be issued only once .subscribe is called on the corresponding observable result.

Query

In Cosmos DB queries can return multiple pages of data. To efficiently read all the pages, simply subscribe and

Share

07

May

Monitoring Azure Kubernetes Service (AKS) with Azure Monitor container health (preview)

Monitoring the health and performance of your Azure Kubernetes Service (AKS) cluster is important to ensure that your applications are up and running as expected. If you run applications on other Azure infrastructure, such as Virtual Machines, you have come to rely on Azure Monitor to provide near real-time, granular monitoring data. We are happy to announce that you can now rely on Azure Monitor to also track the health and performance of your AKS cluster. Let’s look at the new container health monitoring capability in Azure Monitor.

You can enable container monitoring from the Azure portal when you create an AKS cluster. You may notice the prompt for a Log Analytics workspace, and the reason for this will become clear throughout this post. For now, just know that you are providing a central location to store your container logs.

Now that you have gone through the wizard and setup AKS cluster with container health, let’s go through an example to see how you would use it. Start by clicking on Health in AKS. Let’s say, you believe there is a possible resource bottleneck somewhere in your Kubernetes cluster. Since you aren’t sure exactly what and where the issue

Share

07

May

Virtual Network Service Endpoints for Azure #CosmosDB is now generally available

This blog was co-authored by Anitha Adusumilli​, Principal Program Manager, Azure Networking and Sumeet Mittal, Program Manager, Azure Networking.

Azure Cosmos DB is Microsoft’s globally distributed, multi-model database service for mission-critical applications. Azure Cosmos DB provides turnkey global distribution, elastic scaling of throughput and storage worldwide, single-digit millisecond latencies at the 99th percentile, five well-defined consistency models, and guaranteed high availability, all backed by industry-leading comprehensive SLAs. Azure Cosmos DB automatically indexes all your data without requiring you to deal with schema or index management. It is a multi-model service and supports document, key-value, graph, and column-family data models.

Improved security capabilities

We are excited to announce the general availability of Virtual Network Service Endpoints for Azure Cosmos DB. Azure Cosmos DB uses Virtual Network Service Endpoints to create network rules that allow traffic only from selected Virtual Network and subnets. This feature is now available in all regions of Azure public cloud.

Customers can combine existing authorization mechanisms like Firewall Access Control List (ACL) with the new network boundaries to provide an enhanced security for their data. Azure Cosmos DB is the first service to allow cross region access control support where customer can restrict access to globally distributed

Share

07

May

Kubernetes on Azure: Industry’s best end-to-end Kubernetes experience

With Kubernetes exploding in popularity worldwide, it’s no surprise that Kubernetes usage on Azure has grown more than 10x over the last year. Customers love the agility, reliability, and scalability benefits provided by container orchestrators like Kubernetes. Early reviews of our AKS, our managed Kubernetes service, demonstrate serious interest from customers of all shapes and sizes. For Build 2018, we’re thrilled to announce some big improvements to the Kubernetes experience on Azure.

Azure Kubernetes Service

To start, our managed Kubernetes service has been renamed to Azure Kubernetes Service (AKS). AKS is now officially part of the Kubernetes Conformance Program, designed to ensure consistency and portability of Kubernetes across different environments.

AKS made easy

We want every developer to try Kubernetes on Azure, whether they are familiar with containers or not. We have two new announcements that make AKS easier than ever:

DevOps Project support for AKS – with a few simple clicks developers can create a new AKS cluster, containerize their application, deploy with a VSTS CI/CD pipeline, and view integrated App Insights telemetry – all through DevOps Project. New Azure Portal experience for AKS – we are thrilled to showcase the new AKS create and browse experiences inside the

Share

03

May

Azure expands certification scope of Health Information Trust Alliance Common Security Framework

I’m proud to announce that our Azure Health Information Trust Alliance (HITRUST) Common Security Framework (CSF) Certification was not only renewed by HITRUST, but our certification scope has expanded from last year by more than 250 percent! The HITRUST CSF Certification is the most widely recognized security accreditation in the healthcare industry. The HITRUST CSF builds on Health Insurance Portability and Accountability Act (HIPAA) and the Health Information Technology for Economic and Clinical Health (HITECH) Act, by providing a framework for complex compliance requirements that include technical and process elements such as HIPAA, National Institute of Standards and Technology (NIST), The Information Services Office (ISO) and Control Objectives for Information and Related Technologies (COBIT) to ensure controls are in place to safeguard Protected Health Information (PHI).
   
Health customers can further leverage our HITRUST CSF Certification as part of their own certification process when they build on Azure. To accelerate adoption and utilization for customers managing health data, we also recently released the Azure Security and Compliance Blueprint – HIPAA/HITRUST Health Data and AI, which provides tools and guidance for building HIPAA/HITRUST solutions.

Our greatly expanded HITRUST CSF assessment is another indication of our commitment to safeguarding information and maintaining

Share

01

May

Azure Marketplace new offers: April 1–15
Azure Marketplace new offers: April 1–15

We continue to expand the Azure Marketplace ecosystem. From April 1st to 15th, 20 new offers successfully met the onboarding criteria and went live. See details of the new offers below:

(Basic) Apache NiFi 1.4 on Centos 7.4: A CentOS 7.4 VM running a basic install of Apache NiFi 1.4 using default configurations. Once the virtual machine is deployed and running, Apache NiFi can be accessed via web browser.

Ethereum developer kit (techlatest.net): If you are looking to get started with Ethereum development and want an out-of-the-box environment to get up and running in minutes, this VM is for you. It includes the Truffle Ethereum framework, a world-class development environment.

xID: eXtensible IDentity (xID) is an open (standards based), modular (componentized architecture), secure (security built-in), and pluggable (adaptor-based integration approach) product built specially for delivering your organization’s identity management needs.

Qualys Virtual Scanner Appliance: Qualys Virtual Scanner Appliance helps you get a continuous view of security and compliance, putting a spotlight on your Microsoft Azure cloud infrastructure. It’s a stateless resource that acts as an extension to the Qualys Cloud Platform.

FileCloud on Ubuntu Linux: FileCloud

Share

01

May

Monitor Microsoft peering in ExpressRoute with Network Performance Monitor – public preview

We are excited to announce the public preview of Network Performance Monitor’s (NPM) new capability to monitor Microsoft peering in ExpressRoute. This complements NPM’s generally available capability to monitor ExpressRoute’s Azure Private peering. Throughout this post, I will walk you through some of the important use cases of the capability.

Get complete visibility into the ExpressRoute connection to the Microsoft services

It can become extremely difficult to identify the bottleneck when a performance degradation is experienced while accessing a Microsoft service over ExpressRoute. This is because an ExpressRoute connection comprises of various components. With this capability, you can now get the required end-to-end visibility through NPM’s interactive topology view. You can not only view all the constituent components – on-premises network, circuit provider edge, ExpressRoute circuit, Microsoft edge, but also the latency contributed by each hop to help you identify the troublesome segment.

The following snippet illustrates a topology view where the on-premises computer on the left is connected to the Microsoft service (outlook.office365.com) on the right, over primary and secondary ExpressRoute Microsoft peering connections. The service provider router at the customer edge and the Microsoft router at the Azure edge are also depicted. The on-premises hops (depicted by dashed

Share