Releases: microsoft/sql-spark-connector
Spark 3.4 Connector Beta release
This is a beta release for spark 3.4 spark-mssql connector. Connector jar is available below as spark-mssql-connector_2.12-1.4.0-BETA.
Release Notes:
- Support for Spark 3.4.
- Maven release ETA is not available at this point.
Spark 3.3 Connector Beta release
The connector is available on Maven: https://search.maven.org/artifact/com.microsoft.azure/spark-mssql-connector_2.12 and can be imported using the coordinate com.microsoft.azure:spark-mssql-connector_2.12:1.3.0.
- Support Spark 3.3
- Set the JDBC connection application name to "Spark MSSQL Connector" by default
- Remove brackets for staging table name in NO_DUPLICATES mode
Note : The change in not compatible with JDBC 7.0.1, Spark 2.4 or Spark 3.0. For JDBC 7x, Spark 2.4x and 3.0x, please continue to use the old connector release.
Spark 3.1 connector GA
The connector is available on Maven: https://search.maven.org/artifact/com.microsoft.azure/spark-mssql-connector_2.12 and can be imported using the coordinate com.microsoft.azure:spark-mssql-connector_2.12:1.2.0.
- Support Spark 3.1
- Fix NO_DULICATES staging table name to enable parallel write to SQL table
Note : The change in not compatible with JDBC 7.0.1, Spark 2.4 or Spark 3.0. For JDBC 7x, Spark 2.4x and 3.0x, please continue to use the old connector release.
Spark 3.0 connector GA
The connector is available on Maven: https://search.maven.org/artifact/com.microsoft.azure/spark-mssql-connector_2.12 and can be imported using the coordinate com.microsoft.azure:spark-mssql-connector_2.12:1.1.0
.
- Added profiles for spark 2.4 and spark 3.0 build
- Provided test app and framework for spark mssql connector E2E tests
Note : The change in not compatible with JDBC 7.0.1. For JDBC 7x, please continue to use the old connector release.
Update supported JDBC version to 8.4.1
The connector is available on Maven: https://search.maven.org/artifact/com.microsoft.azure/spark-mssql-connector_2.11_2.4 and can be imported using the coordinate com.microsoft.azure:spark-mssql-connector:1.0.2
.
- Updated supported JDBC version to 8.4.1
- Removed deprecated classes.
Note : The change in not compatible with JDBC 7.0.1. For JDBC 7x, please continue to use the old connector release.
Add support for computed Columns
The connector is available on Maven: https://search.maven.org/artifact/com.microsoft.azure/spark-mssql-connector and can be imported using the coordinate com.microsoft.azure:spark-mssql-connector:1.0.1
.
- added write support for computed columns.
Releases have now been moved to Maven
The connector is available on Maven: https://search.maven.org/search?q=spark-mssql-connector and can be imported using the coordinate com.microsoft.azure:spark-mssql-connector:1.0.0
. All future releases will be made on Maven instead of in the GitHub releases section.
AAD Support
v1.1 of the Apache Spark Connector for SQL Server and Azure SQL now includes support for AAD authentication.
Apache Spark Connector for SQL Server and Azure SQL
V1 Release of the Apache Spark Connector for SQL Server and Azure SQL