Skip to content

Releases: microsoft/sql-spark-connector

Spark 3.4 Connector Beta release

28 Sep 22:41
eb60462
Compare
Choose a tag to compare

This is a beta release for spark 3.4 spark-mssql connector. Connector jar is available below as spark-mssql-connector_2.12-1.4.0-BETA.

Release Notes:

  • Support for Spark 3.4.
  • Maven release ETA is not available at this point.

Spark 3.3 Connector Beta release

17 Feb 22:50
f1d79ef
Compare
Choose a tag to compare

The connector is available on Maven: https://search.maven.org/artifact/com.microsoft.azure/spark-mssql-connector_2.12 and can be imported using the coordinate com.microsoft.azure:spark-mssql-connector_2.12:1.3.0.

  • Support Spark 3.3
  • Set the JDBC connection application name to "Spark MSSQL Connector" by default
  • Remove brackets for staging table name in NO_DUPLICATES mode

Note : The change in not compatible with JDBC 7.0.1, Spark 2.4 or Spark 3.0. For JDBC 7x, Spark 2.4x and 3.0x, please continue to use the old connector release.

Spark 3.1 connector GA

31 Aug 18:15
e328e20
Compare
Choose a tag to compare

The connector is available on Maven: https://search.maven.org/artifact/com.microsoft.azure/spark-mssql-connector_2.12 and can be imported using the coordinate com.microsoft.azure:spark-mssql-connector_2.12:1.2.0.

  • Support Spark 3.1
  • Fix NO_DULICATES staging table name to enable parallel write to SQL table

Note : The change in not compatible with JDBC 7.0.1, Spark 2.4 or Spark 3.0. For JDBC 7x, Spark 2.4x and 3.0x, please continue to use the old connector release.

Spark 3.0 connector GA

12 Jul 17:50
65066d2
Compare
Choose a tag to compare

The connector is available on Maven: https://search.maven.org/artifact/com.microsoft.azure/spark-mssql-connector_2.12 and can be imported using the coordinate com.microsoft.azure:spark-mssql-connector_2.12:1.1.0.

  • Added profiles for spark 2.4 and spark 3.0 build
  • Provided test app and framework for spark mssql connector E2E tests

Note : The change in not compatible with JDBC 7.0.1. For JDBC 7x, please continue to use the old connector release.

Update supported JDBC version to 8.4.1

06 Jun 04:43
efdd022
Compare
Choose a tag to compare

The connector is available on Maven: https://search.maven.org/artifact/com.microsoft.azure/spark-mssql-connector_2.11_2.4 and can be imported using the coordinate com.microsoft.azure:spark-mssql-connector:1.0.2.

  • Updated supported JDBC version to 8.4.1
  • Removed deprecated classes.

Note : The change in not compatible with JDBC 7.0.1. For JDBC 7x, please continue to use the old connector release.

Add support for computed Columns

05 Jun 22:45
afef156
Compare
Choose a tag to compare

The connector is available on Maven: https://search.maven.org/artifact/com.microsoft.azure/spark-mssql-connector and can be imported using the coordinate com.microsoft.azure:spark-mssql-connector:1.0.1.

  • added write support for computed columns.

Releases have now been moved to Maven

08 Oct 20:58
53434a7
Compare
Choose a tag to compare

The connector is available on Maven: https://search.maven.org/search?q=spark-mssql-connector and can be imported using the coordinate com.microsoft.azure:spark-mssql-connector:1.0.0. All future releases will be made on Maven instead of in the GitHub releases section.

AAD Support

28 Jul 00:28
53434a7
Compare
Choose a tag to compare

v1.1 of the Apache Spark Connector for SQL Server and Azure SQL now includes support for AAD authentication.

Apache Spark Connector for SQL Server and Azure SQL

24 Jun 22:51
53434a7
Compare
Choose a tag to compare

V1 Release of the Apache Spark Connector for SQL Server and Azure SQL