This post was authored by Casey Karst; Program Manager II; Data Systems.
We are pleased to announce that PolyBase in SQL Server 2016 and later can connect to Hadoop clusters with the hadoop.rpc.protection configuration set to Integrity, Privacy or Authentication. By default, PolyBase uses the Authentication setting, but to connect to more secure Hadoop clusters Integrity or Privacy are needed.
Supporting this configuration allows PolyBase to connect and query Hadoop clusters that have wire encryption turned on. This enables a secure connection between Hadoop and SQL Server; as well as, among the Hadoop Data Nodes.
To connect to a Hadoop cluster with the hadoop.rpc.protection set to privacy or integrity, you will need to alter the core-site.xml file that is installed with PolyBase. This file is generally found at C:Program FilesMicrosoft SQL ServerMSSQL13.MSSQLSERVERMSSQLBinnPolybaseHadoopconf.
In order to use the new configuration, you will need to add a new property with the name hadoop.rpc.protection and a value of either privacy or integrity. These values must match the hadoop.rpc.protection configuration on your Hadoop cluster.
<!– RPC Encryption information, PLEASE FILL VALUE IN ACCORDING TO HADOOP CLUSTER CONFIG –> <property> <name>hadoop.rpc.protection</name> <value>privacy</value> </property>
Note: When changing XML files, please ensure that you input the correct
Source: https://blogs.msdn.microsoft.com/sql_server_team/backup-compression-for-tde-enabled-databases-important-fixes-in-sql-2016-sp1-cu4-and-sql-2016-rtm-cu7/ Backup Compression and Transparent Data Encryption (TDE) have been two immensely valuable and popular features for customers in SQL Server. In SQL Server 2016, backup compression was enabled for TDE databases where if you backup a TDE READ MORE
“Data is currency” is the rule of thumb in business. As with money, business data must be accessible, accurate, and usable across disparate contexts if an organization is to realize greater ROI while keeping costs under control. CIOs understand that the need to manage data—its location, composition, and utility—is as important as managing a balance sheet. For many companies, the solution is SQL Server, the industry gold standard for database management.
But what about the many tech startups and cloud enterprises running open-source platforms? These organizations face challenges with reliably integrating, categorizing, and accessing all types of business data in an often-heterogeneous world of platforms, apps, and devices.
The good news is SQL Server 2017 runs on Linux. Two Linux-based organizations, Convergent Computing and dv01, migrated to SQL Server 2017 for the capabilities and tools to manage and optimize their data “currency.” They share their stories in the new e-book, SQL Server 2017 on Linux: Top Six Reasons Companies Make the Move.
In the e-book, leadership at Convergent and dv01 cover the benefits they gained with SQL on Linux, including:
Flexibility. Use familiar languages on the platform and cloud of your choice. Performance. Take advantage of faster queries with simultaneous
Are you looking for your biggest career opportunity at Microsoft? It’s an exciting time to become part of the Cloud and Enterprise team in the Enterprise Partner Group (EPG). As Global Technical Lead for Data Platform I am excited about READ MORE
From Data Plaform Blog: Lighting up interactive insights on big data By T. K. “Ranga” Rengarajan, corporate vice president, Data Platform Today, we’re announcing the public preview of Spark for Azure HDInsight and the upcoming general availability of Power BI READ MORE
From Data Plaform Blog: We are pleased to announce the availability of Datazen Publisher for Windows 7 Preview. Datazen Publisher is the single point for creation and publishing of rich, interactive visualizations. You can simply connect to the Datazen Server READ MORE
From Data Platform Blog: Today we are pleased to announce availability of the Community Technology Preview (CTP) of the Microsoft JDBC 4.2 Driver for SQL Server! The driver provides robust data access to Microsoft SQL Server and Microsoft Azure SQL READ MORE
From Data Platform Blog: From Tiffany Wissner, Senior Director, Data Platform In the SQL Server CTP 2 blog, T.K. Ranga Rengarajan, CVP of SQL Server engineering, discussed bringing cloud first innovations to SQL Server 2016. This includes a rapid preview model READ MORE
From Data Platform Blog: Following the release of SQL Server 2016 CTP 2.0 last month, the SQL Server engineering team is excited to announce the immediate availability of CTP 2.1 release for download. The release includes improvements for three new READ MORE
From Data Platform Blog: By Tiffany Wissner, Senior Director, Data Platform At the Build conference in April, we announced Azure SQL Data Warehouse, our new enterprise-class elastic data warehouse-as-a-service. Today, we’re pleased to announce that Azure SQL Data Warehouse is READ MORE