Category Archives : Database

12

Jul

Lightning fast query performance with Azure SQL Data Warehouse

Azure SQL Data Warehouse is a fast, flexible and secure analytics platform for enterprises of all sizes. Today we announced significant query performance improvements for Azure SQL Data Warehouse (SQL DW) customers enabled through enhancements in the distributed query execution layer.

Analytics workload performance is determined by two major factors, I/O bandwidth to storage and repartitioning speed, also known as shuffle speed. In this previous blog post, we described how SQL DW caches relevant data to take advantage of NVMe based local storage. In this blog post, we will go under the hood of SQL DW, to see how the shuffling speed has improved.

Data movement is an operation where parts of the distributed tables are moved to different nodes during query execution. This operation is required where the data is not available on the target node, most commonly when the tables do not share the distribution key. The most common data movement operation is shuffle. During shuffle, for each input row, SQL DW computes a hash value using the join columns and then sends that row to the node that owns that hash value. Either one or both sides of join can participate in the shuffle. The diagram below

12

Jul

Announcing new offers and capabilities that make Azure the best place for all your apps, data, and infrastructure

Just a few months back, I wrote about how we are helping companies move to the cloud with a flexible hybrid approach and cost-effective path to Azure. To help our customers realize even greater savings and simplify the migration to Azure, I’m pleased to share some exciting updates to address these customer needs.

Migrate to Azure with free Windows Server and SQL Server 2008 Extended Security Updates

Windows Server and SQL Server 2008/2008 R2 were hugely popular when they launched nearly 10 years ago and have been deployed in millions of instances worldwide. Our customers continue to run many of their business applications on these servers. With the decade anniversary coming, both these versions are nearing end of support – with SQL Server 2008 end of support in July 2019 and Windows Server 2008 end of support in January 2020. We know many customers want to continue with these servers, and we are here to help ensure all our customers have great options.

Today, we are announcing that we will provide extended security updates for three years past the end of support dates for free when running in Azure. This means customers get the efficiency of running servers in Azure,

03

Jul

New Azure #CosmosDB Explorer now in public preview
New Azure #CosmosDB Explorer now in public preview

Today we’re excited to announce Azure Cosmos DB Explorer, a full screen standalone web-based version of the Data Explorer many of you already use in Azure Portal for Cosmos DB.

With Cosmos DB Explorer you can:

Take advantage of the full screen real estate for your queries and results. Access your database account and collections with a connection string, without needing access to the Azure subscription or portal. Share query results with authorized peers who do not have Azure portal access. Work with Cosmos DB data without having to download any desktop tools locally.

From Azure Portal, you can open your account in Cosmos DB Explorer by clicking on the Open Full Screen button in Data Explorer blade.

In the drop-down dialog you can choose the type of access you’d like to open the account with and click Open, “read & write” is default. You can also copy the Cosmos DB Explorer link and share with your colleagues, for example if you want to share read-only results of a query with teammates who don’t have access to Azure Portal.

When you open Cosmos DB Explorer this way, the access will expire in few hours for security reasons. After

03

Jul

New Azure #CosmosDB Explorer now in public preview
New Azure #CosmosDB Explorer now in public preview

Today we’re excited to announce Azure Cosmos DB Explorer, a full screen standalone web-based version of the Data Explorer many of you already use in Azure Portal for Cosmos DB.

With Cosmos DB Explorer you can:

Take advantage of the full screen real estate for your queries and results. Access your database account and collections with a connection string, without needing access to the Azure subscription or portal. Share query results with authorized peers who do not have Azure portal access. Work with Cosmos DB data without having to download any desktop tools locally.

From Azure Portal, you can open your account in Cosmos DB Explorer by clicking on the Open Full Screen button in Data Explorer blade.

In the drop-down dialog you can choose the type of access you’d like to open the account with and click Open, “read & write” is default. You can also copy the Cosmos DB Explorer link and share with your colleagues, for example if you want to share read-only results of a query with teammates who don’t have access to Azure Portal.

When you open Cosmos DB Explorer this way, the access will expire in few hours for security reasons. After

02

Jul

Agile SAP development with SAP Cloud Platform on Azure

This blog post was co-authored by Mario Szpuszta, Principal Software Engineer, Azure CAT

Recently we announced that SAP Cloud Platform is transitioning from Beta to general availability on Azure. SAP Cloud Platform (SAP CP) is SAP’s multi-cloud platform-as-a-service offering and is now available for production use in Azure West Europe.

With SAP CP on Azure, we extend the choices available on Azure to meet your SAP development needs.  SAP CP offers a fully managed platform-as-a-service, operated by SAP, and is the first multi-tenant and fully managed Cloud Foundry PaaS on Azure. With SAP CP running on Azure, customers can

Leverage a broad range of certified SAP HANA offerings on Azure. Integrate with Azure-Native Services such as EventHubs, AzureSQL Database, Azure CosmosDB, Azure ServiceBus etc., using Meta Azure Service Broker. Integrate with Azure Active Directory to enable Single-Sign-On for SAP Cloud Platform SAP Cloud Platform on Azure – Getting started

To get started with SAP CP on Azure, login to your SAP CP account. Pick Cloud Foundry and select Europe (Netherlands) Azure region. This will create an Organization and Space within the SAP CP Cloud Foundry environment.

Deploying applications and services

Developers can use either the SAP CP cockpit

02

Jul

Securing the connection between Power BI and Azure SQL Database

How can you connect to Azure SQL Database from the Power BI service in a secure fashion? The easiest way to limit access to the database is to select the “allow access to Azure Services” option (Figure1). This can be found in the database server options in the Azure portal. This allows Power BI to access your database. However, it also makes the database visible to any component deployed within Azure, such as a virtual machine. For many organizations this is not sufficient for their security and compliance requirements.


Figure 1: Setting the database access in the Azure Portal.

  The following is a list of suggestions that one may want to consider achieving the organizations security goals:

To start, use VNet service endpoints to further secure access. This feature was introduced at the start of 2018. This is easy to configure. In the Azure portal either create a new virtual network or edit an existing VNet and enable service endpoints for SQL in the VNet (Figure2).

Figure 2: Creating a service endpoint in the virtual network.

Once completed, the next task is to set up a virtual network rule on the database server. This allows us to restrict

27

Jun

Azure Elastic Database jobs is now in public preview

We are excited to announce the availability of a new, significantly upgraded public preview release of Azure Elastic Database jobs. Elastic Database jobs is now a fully Azure-hosted service. Unlike the earlier, customer-hosted and managed version of Elastic Database jobs, this version is an integral part of Azure with no additional services or components to install and configure. This release also adds significant capabilities making it easy for customers to automate and execute T-SQL jobs using PowerShell, REST, or T-SQL APIs against a group of databases. These jobs can be used to handle a wide variety of tasks such as index rebuilding, schema updates, collection of query results for analytics, and performance monitoring.

Imagine you are a SaaS developer in the cloud offering online ordering services for a collection of large stores. To support this and allow unlimited scale, you’ve provisioned separate Azure SQL databases to handle each store’s business, and this set of databases share a common schema. While your application directs customer transactions to the appropriate store’s databases, you want the capability to easily manage all databases jointly to ensure the performance and customer experience remain optimal. Additionally, you periodically have new schema to deploy to each database

27

Jun

Azure Elastic Database jobs is now in public preview

We are excited to announce the availability of a new, significantly upgraded public preview release of Azure Elastic Database jobs. Elastic Database jobs is now a fully Azure-hosted service. Unlike the earlier, customer-hosted and managed version of Elastic Database jobs, this version is an integral part of Azure with no additional services or components to install and configure. This release also adds significant capabilities making it easy for customers to automate and execute T-SQL jobs using PowerShell, REST, or T-SQL APIs against a group of databases. These jobs can be used to handle a wide variety of tasks such as index rebuilding, schema updates, collection of query results for analytics, and performance monitoring.

Imagine you are a SaaS developer in the cloud offering online ordering services for a collection of large stores. To support this and allow unlimited scale, you’ve provisioned separate Azure SQL databases to handle each store’s business, and this set of databases share a common schema. While your application directs customer transactions to the appropriate store’s databases, you want the capability to easily manage all databases jointly to ensure the performance and customer experience remain optimal. Additionally, you periodically have new schema to deploy to each database

27

Jun

Azure Data Factory new capabilities are now generally available

Microsoft is excited to announce the General Availability of new Azure Data Factory (ADF V2) features that will make data integration in the cloud easier than ever before. With a new browser-based user interface, you can accelerate your time to production by building and scheduling your data pipelines using drag and drop. Manage and monitor the health of your data integration projects at scale, wherever your data lives, in cloud or on-premises, with enterprise-grade security. ADF comes with support for over 70 data source connectors and enables you to easily dispatch data transformation jobs at scale to transform raw data into processed data that is ready for consumption by business analysts using their favorite BI tools or custom applications.

For existing SQL Server Integration Services (SSIS) users, ADF now allows you to easily lift and shift your SSIS packages into the cloud and run SSIS as a service with minimal changes required to your existing packages. ADF will now manage your SSIS resources for you so you can increase productivity and lower total cost of ownership. Meet your security and compliance needs while taking advantage of extensive capabilities and paying only for what you use.

All of these new Azure

27

Jun

Azure Data Factory new capabilities are now generally available

Microsoft is excited to announce the General Availability of new Azure Data Factory (ADF V2) features that will make data integration in the cloud easier than ever before. With a new browser-based user interface, you can accelerate your time to production by building and scheduling your data pipelines using drag and drop. Manage and monitor the health of your data integration projects at scale, wherever your data lives, in cloud or on-premises, with enterprise-grade security. ADF comes with support for over 70 data source connectors and enables you to easily dispatch data transformation jobs at scale to transform raw data into processed data that is ready for consumption by business analysts using their favorite BI tools or custom applications.

For existing SQL Server Integration Services (SSIS) users, ADF now allows you to easily lift and shift your SSIS packages into the cloud and run SSIS as a service with minimal changes required to your existing packages. ADF will now manage your SSIS resources for you so you can increase productivity and lower total cost of ownership. Meet your security and compliance needs while taking advantage of extensive capabilities and paying only for what you use.

All of these new Azure