02

Jul

Azure Search – Announcing the general availability of synonyms

Today we are announcing the general availability of synonyms. Synonyms allow Azure Search to associate equivalent terms that implicitly expand the scope of a query, without the user having to provide the alternate terms.

A good example of this capability was demonstrated at the recent Microsoft Build conference, where we showed how NBA.com searches their vast photo library of players, owners, and celebrities. In this application Azure Search synonyms are used to enable nicknames of Lebron James such as “The King” or “King James” to be returned regardless of which of the three terms are used in the query.

In Azure Search, synonym support is based on synonym maps that you define and upload to your search service. These maps constitute an independent resource, such as indexes or data sources, and can be used by any searchable field in any index in your search service. Synonym maps use the Apache Solr format as outlined in the example synonym map below:

POST https://[servicename].search.windows.net/synonymmaps?api-version=2017-11-11 api-key: [admin key] { “name”:”mysynonymmap”, “format”:”solr”, “synonyms”: ” USA, United States, United States of American Washington, Wash., WA => WAn” }

In the above example, you can see there are two types of synonyms that are

Share

02

Jul

Azure.Source – Volume 38
Azure.Source – Volume 38

Announcements at GeekWire Cloud Tech Summit

Microsoft from GeekWire Cloud Tech Summit: New Azure innovations will advance the intelligent cloud and intelligent edge – Mark Russinovich CTO, Microsoft Azure, covers announcements he made at the GeekWire Cloud Tech Summit. He also discussed how customers are using the cloud and what the future holds with GeekWire’s Todd Bishop and Tom Krazit. This post provides a roll-up of the announcements made at the summit, which are covered in more details in the posts below.

The next level in big data analytics

Azure simplifies cloud analytics – This post provides a roll-up of the big data analytics news, including the preview release of Azure Data Lake Storage Gen2, which unifies the core capabilities from the first generation of Azure Data Lake with a Hadoop compatible file system endpoint now directly integrated into Azure Blob Storage. This enhancement combines the scale and cost benefits of object storage with the reliability and performance typically associated only with on-premises file systems.

Azure Friday | Episode 446 – Azure Data Lake Storage Gen2 overview – James Baker joins Lara Rubbelke to introduce Azure Data Lake Storage Gen2, which is redefining cloud

Share

02

Jul

Securing the connection between Power BI and Azure SQL Database

How can you connect to Azure SQL Database from the Power BI service in a secure fashion? The easiest way to limit access to the database is to select the “allow access to Azure Services” option (Figure1). This can be found in the database server options in the Azure portal. This allows Power BI to access your database. However, it also makes the database visible to any component deployed within Azure, such as a virtual machine. For many organizations this is not sufficient for their security and compliance requirements.


Figure 1: Setting the database access in the Azure Portal.

  The following is a list of suggestions that one may want to consider achieving the organizations security goals:

To start, use VNet service endpoints to further secure access. This feature was introduced at the start of 2018. This is easy to configure. In the Azure portal either create a new virtual network or edit an existing VNet and enable service endpoints for SQL in the VNet (Figure2).

Figure 2: Creating a service endpoint in the virtual network.

Once completed, the next task is to set up a virtual network rule on the database server. This allows us to restrict

Share

02

Jul

Spoken Language Identification in Video Indexer

We are excited to share that Video Indexer has a new capability, Spoken Language Identification (LID)!

A common ask from our customers has been to enable indexing of videos or batches of videos, without manually providing their language. This is especially important for batch uploads. To support this, we have introduced automatic spoken language identification to Video Indexer. The identified language is used to invoke the appropriate speech-to-text model.

LID is based on state of the art Deep Learning applied on the audio. LID currently supports eight languages including English, Chinese, French, German, Italian, Japanese, Spanish, and Russian. It works with high accuracy for high-to-mid quality recordings. We are working on adding more languages to the list, so stay tuned.

Let’s learn more about LID in Video Indexer.

Using LID in Video Indexer

To use the LID capability, you have two options. If you use the portal, you can now select Auto detect in the language selection combo box when uploading a video.

If you use the API to upload a video, use auto as the language parameter value.

Attribute sourceLanguage in the video index JSON under root/videos/insights is assigned the detected language, and attribute sourceLanguageConfidence:

Note to

Share

02

Jul

Azure Databricks provides the best Apache Spark™-based analytics solution for data scientists and engineers

Azure Databricks provides a fast, easy, and collaborative Apache Spark-based analytics platform to accelerate and simplify the process of building Big Data and AI solutions that drive the business forward, all backed by industry leading SLAs.

I am excited to announce the availability of a set of new features and regions, which enable our customers to accelerate their AI journey with Azure Databricks.

RStudio integration generally available with Azure Databricks

Today, we are announcing the ability to use RStudio with Azure Databricks. Customers can now analyze data with RStudio while taking advantage of the scale and flexibility of Azure Databricks.

RStudio offers in a rich IDE that is very popular with the data scientists in the R community. With this integration, RStudio runs directly inside Azure Databricks. This enables data scientists to continue to use the familiar and powerful RStudio IDE while gaining the ability to build their solutions at unprecedented scale. Azure Databricks provides the flexibility to start with small jobs and automatically scale up to production workloads in the same environment.

Setting up RStudio in Azure Databricks is simple and fast. Learn how to get started today.

Azure Databricks available in Australia and UK

We are excited

Share

02

Jul

Azure Backup hosts Ask Me Anything session

The Azure Backup team will host a special Ask Me Anything session on Twitter, Tuesday, June 26, 2018 from 7:30 AM to 11:30 AM PST. You can tweet to @AzureBackup or @AzureSupport with #AzureBackupAMA

What’s an AMA session?

We’ll have folks from across the Azure Backup Engineering team available to answer any questions you have. You can ask us anything about our products, services or even our team!

Why are you doing an AMA?

We like reaching out and learning from our customers and the community. We had great conversations in the past when we did an AMA in 2016 and 2015. We want to know how you use Azure and Azure Backup and how your experience has been. Your questions provide insights into how we can make the service better.

How do I ask questions on Twitter?

You can ask us your questions by putting “#AzureBackupAMA” in your tweet. Your question can span multiple tweets by replying to first tweet you post with this hashtag.  You can also directly message @AzureBackup or @AzureSupport if you want to keep your questions private. You can start posting your questions one day before the scheduled time of AMA but we will start

Share

02

Jul

Monitor Azure Data Factory pipelines using Operations Management Suite

Data Integration solutions can be complex with many moving parts involving complex data factories with multiple pipelines. Monitoring provides data to ensure that your data factory pipelines stay up and running in a healthy state. It also helps you to stave off potential problems or troubleshoot past ones. In addition, you can use monitoring data to gain deep insights about your application. This knowledge can help you to improve application performance or maintainability, or automate actions that would otherwise require manual intervention.

Azure Data Factory (ADF) integration with Azure Monitor allows you to route your data factory metrics to Operations and Management (OMS) Suite. Now, you can monitor the health of your data factory pipelines using ‘Azure Data Factory Analytics’ OMS service pack available in Azure marketplace.

Azure Data Factory OMS pack provides you a summary of overall health of your Data Factory, with options to drill into details and to troubleshoot unexpected behavior patterns. With rich, out of the box views you can get insights into key processing including:

At a glance summary of data factory pipeline, activity and trigger runs Ability to drill into data factory activity runs by type Summary of data factory top pipeline,

Share

29

Jun

TEMPDB – Files and Trace Flags and Updates, Oh My!
TEMPDB – Files and Trace Flags and Updates, Oh My!

https://blogs.msdn.microsoft.com/sql_server_team/tempdb-files-and-trace-flags-and-updates-oh-my/Source: https://blogs.msdn.microsoft.com/sql_server_team/tempdb-files-and-trace-flags-and-updates-oh-my/   TL;DR – Update to the latest CU, create multiple tempdb files, if you’re on SQL 2014 or earlier enable TF 1117 and 1118, if you’re on SQL 2016 enable TF 3427. And now it’s time for everyone’s READ MORE

Share

29

Jun

On-premises data gateway June update is now available
On-premises data gateway June update is now available

https://powerbi.microsoft.com/en-us/blog/on-premises-data-gateway-june-update-is-now-available/Source: https://powerbi.microsoft.com/en-us/blog/on-premises-data-gateway-june-update-is-now-available/           We are happy to announce that we have just released the June update for the On-premises data gateway.   This month’s Gateway update includes an updated version of the Mashup Engine, which…

Share

29

Jun

Migrating IoT Edge solutions to GA
Migrating IoT Edge solutions to GA

On Wednesday, June 27, 2018, we announced the general availability of Azure IoT Edge. This release adds tons of new features for those already using public preview bits. Customers who have never used Azure IoT Edge can start with the Linux or Windows quickstarts. Those who have started projects on preview bits should upgrade to the latest bits and integrate breaking changes.  Details on both of these processes are below.

Upgrade to the latest bits Uninstall preview bits

Use iotedgectl to uninstall the preview bits from your Edge device by running the following command. You can skip this step if you are installing GA bits on a device or VM that has never run preview bits.

iotedgectl uninstall Delete preview runtime container images

Use “docker rmi” to remove the container images for preview versions of Edge Agent and Edge Hub from your Edge device. You can skip this step if you are installing GA bits on a device or VM that has never run preview bits.

Remove references to preview container images in deployments

The IoT Edge Security Daemon includes functionality to allow the user to specify which versions of the Edge Agent and Edge Hub are used by

Share