18

Feb

Getting more statistics information programatically
Getting more statistics information programatically

Source: https://blogs.msdn.microsoft.com/sql_server_team/getting-more-statistics-information-programatically/   As the building blocks which the Query Optimizer uses to know data distribution on tables, to then calculate a good enough plan to read data, when engaging in query performance troubleshooting, information about statistics is something you READ MORE

17

Feb

Connecting your own Hadoop or Spark to Azure Data Lake Store
Connecting your own Hadoop or Spark to Azure Data Lake Store

Source: https://blogs.msdn.microsoft.com/azuredatalake/2017/02/17/connecting-your-own-hadoop-or-spark-to-azure-data-lake-store/   A frequent question we get is how do I connect my Hadoop or Spark cluster to Azure Data Lake Store. Turns out it is really easy to do. Here is a step by step article that will READ MORE

17

Feb

Quick-Start Guide to the Data Science Bowl Lung Cancer Detection Challenge, Using Deep Learning, Microsoft Cognitive Toolkit and Azure GPU VMs

This post is by Miguel Fierro, Data Scientist, Ye Xing, Senior Data Scientist, and Tao Wu, Principal Data Scientist Manager, all at Microsoft.

Since its launch in mid-January, the Data Science Bowl Lung Cancer Detection Competition has attracted over than 1,000 submissions. To be successful in this competition, data scientists need to be able to get started quickly and make rapid iterative changes. In this post, we show how to compute features of the scanned images in the competition with a pre-trained Convolutional Neural Network (CNN), and use these features to classify the scans into cancerous or not cancerous, using a boosted tree, all in one hour. With a score of 0.55979, you would be ranked in the top 10% as of January 19th on the leaderboard, or in the top 20% as of February 7th.

To achieve this, we used the following:

A pre-trained CNN as the image featurizer. This 152-layer ResNet model is implemented on the Microsoft Cognitive Toolkit deep learning framework (formerly called CNTK) and trained using the ImageNet dataset.
LightGBM gradient boosting framework as the image classifier.
Azure Virtual Machines (VMs) with GPU acceleration.

For the impatient, we have shared our code in this Jupyter notebook.

17

Feb

SQL Server next version CTP 1.3 now available
SQL Server next version CTP 1.3 now available

Microsoft is excited to announce a new preview for the next version of SQL Server (SQL Server v.Next). Community Technology Preview (CTP) 1.3 is available on both Windows and Linux. In this preview, we added several feature enhancements to High Availability and Disaster Recovery (HADR), including the ability to run Always On Availability Groups on Linux. You can try the preview in your choice of development and test environments now: www.sqlserveronlinux.com.

Key CTP 1.3 enhancement: Always On Availability Groups on Linux

In SQL Server v.Next, we continue to add new enhancements for greater availability and higher uptime. A key design principle has been to provide customers with the same HA and DR solutions on all platforms supported by SQL Server. On Windows, Always On depends on Windows Server Failover Clustering (WSFC). On Linux, you can now create Always On Availability Groups, which integrate with Linux-based cluster resource managers to enable automatic monitoring, failure detection and automatic failover during unplanned outages. We started with the popular clustering technology, Pacemaker.

In addition, Availability Groups can now work across Windows and Linux as part of the same Distributed Availability Group. This configuration can accomplish cross-platform migrations without downtime. To learn more, you can

17

Feb

Azure IoT turbocharged with new Azure Stream Analytics features
Azure IoT turbocharged with new Azure Stream Analytics features

Source: https://blogs.microsoft.com/iot/2017/02/17/azure-iot-turbocharged-with-new-azure-stream-analytics-features/     IoT solutions must monitor real-time data coming from devices and take action when troubling patterns are found. This capability is referred to as “stream processing,” and at the scale of IoT, customers need a robust and READ MORE

17

Feb

SQL Server on Linux: Mission-critical HADR with Always On Availability Groups

This post was authored by Mihaela Blendea, Senior Program Manager, SQL Server

In keeping with our goal to enable the same High Availability and Disaster Recovery solutions on all platforms supported by SQL Server, today Microsoft is excited to announce the preview of Always On Availability Groups for Linux in SQL Server v.Next Community Technology Preview (CTP) 1.3. This technology adds to the HADR options available for SQL Server on Linux, having previously enabled shared disk failover cluster instance capabilities.

First released with SQL Server 2012 and enhanced in the 2014 and 2016 releases, Always On Availability Groups is SQL Server’s flagship solution for HADR. It provides High Availability for groups of databases on top of direct attached storage, supporting multiple active secondary replicas for integrated HA/DR, automatic failure detection, fast transparent failover, and read load balancing. This broad set of capabilities is enabling customers to meet the strictest availability SLA requirements for their mission- critical workloads.

Here is an overview of the scenarios that Always On Availability Groups are enabling for SQL Server v.Next:

Run mission-critical application using SQL Server running on Linux

Always On Availability Groups make it easy for your applications to meet rigorous business continuity requirements.

16

Feb

Building advanced analytical solutions faster using Dataiku DSS on HDInsight

Source: https://blogs.msdn.microsoft.com/azuredatalake/2017/02/16/building-advanced-analytical-solutions-faster-using-dataiku-dss-on-hdinsight/   The Azure HDInsight Application Platform allows users to use applications that span a variety of use cases like data ingestion, data preparation, data processing, building analytical solutions and data visualization. In this post we will see how READ MORE

16

Feb

Leveraging Microsoft’s Connected Field Service capabilities to transform your business

Source: https://blogs.microsoft.com/iot/2017/02/16/leveraging-microsofts-connected-field-service-capabilities-to-transform-your-business/     Digital transformation is causing tremendous shifts in how manufacturers do business. Leading firms are moving toward selling services instead of products[1], turning what used to be an expensive operation – fixing failures in the field – READ MORE

16

Feb

Gartner positions Microsoft as a leader in BI and Analytics Platforms for ten consecutive years

Source: https://powerbi.microsoft.com/en-us/blog/gartner-positions-microsoft-as-a-leader-in-bi-and-analytics-platforms-for-ten-consecutive-years/           Gartner has recognized our vision and execution for the tenth consecutive year, positioning Microsoft as a Leader in the Magic Quadrant for Business Intelligence and Analytics Platforms. Also, for second year in row, READ MORE

15

Feb

How to assess IoT security from end to end
How to assess IoT security from end to end

Source: https://blogs.microsoft.com/iot/2017/02/15/how-to-assess-iot-security-from-end-to-end/     As businesses around the world look to adopt IoT or expand their deployments, security may have never been more top of mind. Recent news of hackers using sophisticated malware like Mirai is a reminder that actively READ MORE