We keep enriching the breadth of connectivity in Azure Data Factory to enable customers to ingest data from various data sources into Azure when building modern data warehouse solutions or data-driven SaaS applications. Today, we are excited to announce that Azure Data Factory newly enabled copying data from the following data stores using Copy Activity in V2. You can always find the full supported connector list from supported data stores, and click into each connector topic there to learn more details.
Amazon Marketplace Web Service (Beta) Azure Database for PostgreSQL Concur (Beta) Couchbase (Beta) Drill (Beta) Google BigQuery (Beta) Greenplum (Beta) HBase Hive HubSpot (Beta) Impala (Beta) Jira (Beta) Magento (Beta) MariaDB Marketo (Beta) Oracle Eloqua (Beta) Paypal (Beta) Phoenix Presto (Beta) QuickBooks (Beta) SAP Cloud for Customer (C4C) ServiceNow (Beta) Shopify (Beta) Spark Square (Beta) Xero (Beta) Zoho (Beta)
If you are using PowerShell or .NET/Python SDK to author, make sure you upgrade to the December version to use these new features. And for hybrid copy scenario, note these connectors are supported since Self-hosted Integration Runtime version 3.2.
You are invited to give them a try and provide us feedback. We hope you find them helpful in your scenario.
This post is authored by Alan Yu, Program Manager, SQL Server.
We are excited to announce the December release of SQL Operations Studio is now available.
SQL Operations Studio is a data management tool that enables you to work with SQL Server, Azure SQL DB and SQL DW from Windows, macOS and Linux. To learn more, visit our GitHub.
SQL Operations Studio was announced for Public Preview on November 15th at Connect(), and this December release is the first major update since the announcement.
The December release includes several major repo updates and feature releases, including:
Migrating SQL Ops Studio Engineering to public GitHub repo Azure Integration with Create Firewall Rule Windows Setup and Linux DEB/RPM installation packages Manage Dashboard visual layout editor “Run Current Query with Actual Plan” command
For complete updates, refer to the Release Notes.
Migrating SQL Ops Studio Engineering to public GitHub repo
To provide better transparency with the SQL Operations Studio community, we have decided to migrate the Github internal branch to the public repo. This means any bug fixes, feature developments, or even test builds can be publicly viewed before an
We recently concluded the Fall 2018 edition of the Machine Learning, AI & Data Science (MLADS) conference, Microsoft’s largest internal gathering of employees focused specifically on these areas. This latest edition was the eighth in a popular series that we launched back in 2014. Over 3,500 employees tuned into the sold-out conference, both in person in Redmond and over livestream throughout the world, and thousands more will tune into MLADS session recordings over coming weeks and months.
As application of AI and ML explode both within Microsoft and in our external products and services, the growth of our community interest groups catering to these areas has been very rapid. The MLADS conference itself is unique in that it is almost entirely driven by enthusiastic community volunteers – a band of employees unified in its passion for AI and ML, and a desire to network and learn from one another. The “call for content” that goes out for this conference series routinely gets several hundreds of submissions, and our volunteer team helps triage these submissions and curate the best ones for our event.
The fall 2018 conference featured over 95 talk sessions, 20 tutorials and 65 poster/demo sessions covering a gamut of
Azure customers manage budgets at a workload level and need granular controls on monitoring the spend on cloud services. Workloads sometimes share a subscription and yet need to be budgeted for individually. As a first step in making these granular controls available we are previewing an ARM API to set and manage a budget at the subscription scope. Current EA customers have a similar capability in the EA portal, at the department level. This release is the first step towards making the same set of capabilities work for you across the hierarchy of your management plane.
The budgets API enables you to setup a budget for a subscription, and also setup multiple notification thresholds. To illustrate, you might have a subscription where you setup a budget of $1,000 and setup notifications at 25%, 50%, 75%, and 100%. These notifications would be triggered when your usage costs exceed $250, $500, $750, and $1,000 respectively.
Subscription budget API
The API documentation provides detailed guidance on the operations supported and the payloads. The API supports multiple budgets to be created for a subscription over the duration of the budget. At the end of the duration the budget resets and starts over. For this
The Developer Economics Q4 2017 survey is here in its 14th edition to shed light on the future of the software industry. Every year more than 40,000 developers around the world participate in this survey, so this is a chance to be part of something big, voice your thoughts, and make your own contribution to the developer community.
Is this survey for me?
The survey is for all developers engaging in the following software development areas: cloud, mobile, desktop, IoT, AR/VR, machine learning, data science, web, backend, and gaming.
What questions am I likely to be asked?
The survey asks questions about the status and the future of the software industry.
What’s going up and what’s going down in the software industry? Are you working on the projects you would like to work on? Where do you think development time should be invested? Which are your favorite tools and platforms? What’s in it for me?
There are some perks to go with your participation. Have a look at what you can get our hands on:
Amazing prizes up for grabs: A Pixel 2 phone, an iPhone X, a Windows Acer MR headset, a Nintendo Switch, Raspberry Pi 3’s, and more
Today we are pleased to announce the release of a new Azure Financial Services Regulated Workloads Blueprint.
The Azure Security and Compliance Blueprint Program provides automated solutions and guidance for rapid deployment of Azure services that meet specific regulatory requirements from weeks to a few hours. The new Financial Services Regulated Workloads Blueprint gives you an automated solution that will help guide you in storing and managing sensitive financial information such as payment data in Azure. The Financial Services Blueprint is designed to help customers meet compliance requirements outlined in the American Institute of Certified Public Accountants (AICPA) SOC 1 and SOC 2 standards, the Payment Card Industry Data Security Standard (PCI DSS) version 3.2, as well as the Federal Financial Institutions Examination Council (FFIEC), and Gramm-Leach-Bliley Act (GLBA).
Using the Financial Services Blueprint, you can deploy and securely configure an Azure SQL Database, a web application protected by security services such as Azure App Service Environment (ASE), the Web Application Firewall (WAF), and Azure Security Center (ASC). Automated templates and reference architectures are provided to help you implement the technical controls required to achieve a trusted and more secure end to end compliant deployment.
The Financial Services
This blog post was co-authored by Karan Gulati, Senior Software Engineer, XBOX and Daniel Hagen, Senior Software Engineer, XBOX.
Microsoft Studios produces some of the world’s most popular game titles including the Halo, Minecraft, and Forza Motorsport series. The Xbox product services team manage thousands of datasets and hundreds of active pipelines consuming hundreds of gigabytes of data each hour for first party studios. Game developers need to know the health of their game through measuring acquisition, retention, player progression, and general usage over time. This presents a textbook big data problem where data needs to be cleaned, formatted, aggregated and reported on, better known as ETL (Extract Transform Load).
HDInsight – Fully managed, full spectrum open source analytics service for enterprises
Azure HDInsight is a fully-managed cloud service for customers to do analytics at a massive scale using the most popular open-source frameworks such as Hadoop, MapReduce, Hive, LLAP, Presto, Spark, Kafka, and R. HDInsight enables a broad range of customer scenarios such as batch & ETL, data warehousing, machine learning, IoT and streaming over massive volumes of data at a high scale using Open Source Frameworks.
Key HDInsight benefits
Cloud native: The only service in the
Azure Cosmos DB is Microsoft’s globally distributed, horizontally partitioned, multi-model database service. The service is designed to allow customers to elastically and independently scale throughput and storage across any number of geographical regions. Azure Cosmos DB offers guaranteed low latency at the 99th percentile, 99.999% high availability, predictable throughput, and multiple well-defined consistency models. Azure Cosmos DB is the first and only globally distributed database service in the industry today to offer comprehensive Service Level Agreements (SLAs) encompassing all four dimensions of global distributions which our customers care the most: throughput, latency at the 99th percentile, availability, and consistency. As a cloud service, we have carefully designed and engineered Azure Cosmos DB with multi-tenancy, horizontal scalability and global distribution in mind.
We have just rolled out a few long-awaited changes and we wanted to share them with you:
Entry point for unlimited collections/containers is now 60% cheaper. In February, we’ve lowered entry point for unlimited containers making them 75% cheaper. We continue making improvements in our service and today we are pleased to announce that unlimited containers have now an entry point that is 60% cheaper than before. Instead of provisioning 2,500 RU/sec as a minimum, you can now
We have had tons of interest in our VMware virtualization on Azure offering. This includes questions about what we are offering and how we will provide an enterprise grade solution. Here are some of the details on the preview.
To enable this solution, we are working with multiple VMware Cloud Provider Program partners and running on existing VMware-certified hardware. For example, our preview hardware will use a flexpod bare metal configuration with NetApp storage. This hosted solution is similar to Azure’s bare metal SAP HANA Large Instances solution that we launched last year. With this approach, we will enable you to use the same industry-leading VMware software and services that you currently use in your on-premises datacenters, but running on Azure infrastructure, allowing L3 network connectivity for existing applications to Azure-native services like Azure Active Directory, Azure Cosmos DB, and Azure Functions.
We are facilitating discussions with VMware and the VCPP partners to ensure you have a great solution and a great support experience when we make this offering generally available next year. More details from VMware on this can be found here. We will share more information on GA plans and partners in the coming months. If you’d like
https://powerbi.microsoft.com/en-us/blog/announcing-the-reddit-solution-template/Source: https://powerbi.microsoft.com/en-us/blog/announcing-the-reddit-solution-template/ Today, we are excited to announce a new suite of Power BI solution templates for brand management and targeting on Reddit through a third-party API relationship with SocialGist. These templates complement existing brand-oriented READ MORE