We are pleased to announce the general availability for Azure HDInsight Tools for Visual Studio Code (VSCode). HDInsight Tools for VSCode give developers a cross-platform lightweight code editor for developing HDInsight PySpark and Hive batch jobs and interactive query.
For PySpark developers who value the productivity Python enables, HDInsight Tools for VSCode offer a quick Python editor with simple getting started experiences, and allow you to submit PySpark statements to HDInsight clusters with interactive responses. This interactivity brings the best properties of Python and Spark to developers and empowers you to gain faster insights.
For Hive developers, HDInsight tools for VSCode offer great data warehouse query experiences for big data and helpful features in querying log files and gaining insights.
Key customer benefits Integration with Azure worldwide environments for Azure sign-in and HDInsight cluster management HDInsight Hive and Spark job submission with integration with Spark UI and Yarn UI Interactive responses with the flexibility to execute one or multiple selected Hive and Python scripts Preview and export your interactive query results to CSV, JSON, and Excel format Built-in Hive language services such as IntelliSense auto-suggest, autocomplete, and error marker, among others Supports HDInsight ESP Cluster and Ambari connection Simplified cluster
The Azure Messaging team is continually working to enhance the resiliency and availability of our service offerings – Azure Service Bus, Azure Event Hubs, and Azure Event Grid. As part of this effort, in June 2018, we previewed Azure Service Bus Premium tier for Availability Zones and Azure Event Hubs Standard tier in 3 regions – Central US, East US 2, and France Central.
Today, we’re happy to announce that we’ve added Availability Zones support for Azure Service Bus Premium and Azure Event Hubs Standard in the following regions:
East US 2 West US 2 West Europe North Europe France Central Southeast Asia
Availability Zones is a high availability offering by Azure that protects applications and data from datacenter failures. Availability Zones are unique physical locations within an Azure region. Each zone is made up of one or more datacenters equipped with independent power, cooling, and networking. To ensure resiliency, there’s a minimum of three separate zones in all enabled regions. The physical separation of Availability Zones within a region protects applications and data from datacenter failures. Zone-redundant services replicate your applications and data across Availability Zones to protect from single-points-of-failure.
With this, Azure Service Bus Premium and Azure Event
In today’s security-first digital age, ensuring secure connectivity to IoT devices is of paramount importance. A wide range of operational and maintenance scenarios in the IoT space rely on end-to-end device connectivity in order to enable users and services to interact with, login, troubleshoot, send, or receive data from devices. Security and compliance with the organization’s policies are therefore an essential ingredient across all these scenarios.
Azure IoT Hub device streams is a new PaaS service that addresses these needs by providing a foundation for secure end-to-end connectivity to IoT devices. Customers, partners, application developers, and third-party platform providers can leverage device streams to communicate securely with IoT devices that reside behind firewalls or are deployed inside of private networks. Furthermore, built-in compatibility with the TCP/IP stack makes device streams applicable to a wide range of applications involving both custom proprietary protocols as well standards-based protocols such as remote shell, web, file transfer and video streaming, among others.
At its core, an IoT Hub device stream is a data transfer tunnel that provides connectivity between two TCP/IP-enabled endpoints: one side of the tunnel is an IoT device and the other side is a customer endpoint that intends to communicate with
Azure API Management has just introduced preview support of OpenAPI Specification v3 – the latest version of the broadly used open-source standard of describing APIs. Implementation of the feature is based on the OpenAPI.NET SDK.
In this blog post we will explore:
The benefits of using OpenAPI Specification for your APIs. How you can create APIs from OpenAPI Specification documents in Azure API Management. How you can export your APIs as OpenAPI Specification documents. The remaining work for the general availability release. Why you should use OpenAPI Specification for your APIs
OpenAPI Specification is a widely adopted industry standard. The OpenAPI Initiative has been backed by over 30 companies, including large corporations such as Microsoft.
OpenAPI Specification lets you abstract your APIs from their implementation. The API definitions are language-agnostic.
They are also easy to understand, yet precise. Your APIs are represented through YAML or JSON files, readable for humans as well as machines.
The wide adoption of OpenAPI Specification has resulted in an extensive tooling ecosystem. Functionality of the tools ranges from facilitating collaborative process of designing APIs, to automatically generating client SDKs and server implementations in popular programming languages.
How to import OpenAPI Specification v3 definitions in Azure
https://powerbi.microsoft.com/en-us/blog/power-bi-report-server-update-january-2019/Source: https://powerbi.microsoft.com/en-us/blog/power-bi-report-server-update-january-2019/ Today we are happy to announce our January update of Power BI Report Server! This release has many highly anticipated features such as copy and pasting between pbix files, expand & collapse on READ MORE
https://powerbi.microsoft.com/en-us/blog/new-monetization-option-for-power-bi-custom-visuals-through-appsource/Source: https://powerbi.microsoft.com/en-us/blog/new-monetization-option-for-power-bi-custom-visuals-through-appsource/ Until recently, AppSource offered only Power BI visuals that had no cost associated with them. In order to promote visuals containing advanced features and support a funding model for their development, we’re excited READ MORE
Today I want to show how simple it is to connect a temperature/humidity sensor to Azure IoT Central using a Raspberry Pi and Node-RED.
As many of you know, Raspberry Pi is a small, single-board computer. Its low cost, low power nature makes it a natural fit for IoT projects. Node-RED is a flow-based, drag and drop programming tool designed for IoT. It enables the creation of robust automation flows in a web browser, simplifying IoT project development.
For my example, I’m using a Raspberry Pi 3 Model B and a simple DHT22 temperature and humidity sensor, but it should work with other models of the Pi. If you have a different kind of sensor, you should be able to adapt the guide below to use it, provided you can connect Node-RED to your sensor.
Configuring Azure IoT Central Create an app. Create a new device template. Temp (temp) Humidity (humidity) Create a real device and get the DPS connection information. Use dps-keygen to provision the device and get a device connection string. Identify the three parts of the resulting connection string and save them for later. Connecting the DHT22 sensor
Before we can get data from our
We are excited to reveal a set of new features for backing up Microsoft Azure file shares natively using Azure Backup. All backup-related features have also been released to support file shares connected to Azure File Sync.
Azure files with NTFS ACLs
Azure Backup now supports preserving and restoring new technology file system (NTFS) access control lists (ACL) for Azure files in preview. Starting in 2019, Azure Backup automatically started capturing your file ACLs when backing up file shares. When you need to go back in time, the file ACLs are also restored along with the files and folders.
Use Azure Backup with PowerShell
You can now script your backups for Azure File Shares using PowerShell. Make use of the PowerShell commands to configure backups, take on-demand backups, or even restore files from your file shares protected by Azure Backup.
We have enabled on-demand backups that can retain your snapshots for 10 years using PowerShell. Schedulers can be used to run on-demand PowerShell scripts with chosen retention and thus take snapshots at regular intervals every week, month, or year. Please refer to the limitations of on-demand backups using Azure backup.
If you are looking for sample scripts, please write to AskAzureBackupTeam@microsoft.com. We
We are excited to share the release of the Microsoft Azure HDInsight Metastore Migration Tool (HMMT), an open-source script that can be used for applying bulk edits to the Hive metastore.
The HDInsight Metastore Migration Tool is a low-latency, no-installation solution for challenges related to data migrations in Azure HDInsight. There are many reasons why a Hive data migration may need to take place. You may need to protect your data by enabling secure transfer on your Azure storage accounts. Perhaps you will be migrating your Hive tables from WASB to Azure Data Lake Storage (ADLS) Gen2 as part of your upgrade from HDInsight 3.6 to 4.0. Or you may have decided to organize the locations of your databases, tables, and user-defined functions (UDF) to follow a cohesive structure. With HMMT, these migration scenarios and many others no longer require manual intervention.
HMMT handles Hive metadata migration scenarios in a quick, safe, and controllable environment. This blog post is divided into three sections. First, the background to HMMT is outlined with respect to the Hive metastore and Hive storage patterns. The second section covers the design of HMMT and describes initial setup steps. Finally, some sample migrations are described and
Are you curious how new capabilities in SQL Server will impact your applications? Download and test SQL Server 2017 Developer Edition, a full-featured free edition, licensed for use as a development and test database in a non-production environment. You can browse and access SQL Server code samples at GitHub, and when youre ready, check out your options to move to production.
With SQL Server 2017, you can build modern applications using the language of your choice, on-premises or in the cloud, on Windows, Linux, and Docker containers. Your mission-critical programs will benefit from industry-leading scalability, performance, and availability. And SQL Server 2017 is the only commercial database with AI built-in, enabling you to build intelligent applications using scalable and highly parallelized R and Python. Read the datasheet and white paper for more details.
If youre a Linux developer, SQL Server 2017 brings the database you want to the platform you loveand dont just take our word for it. Browse technical FAQs from your peers in our quick start guide.
SQL Server 2017 Developer Edition does not include a licensed OS, such as a license for Windows 10 included on a new laptop. 90 to 180 day free trials of Windows