Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for spark v3.3.1 #1123

Open
natilivni opened this issue Nov 16, 2022 · 3 comments
Open

Support for spark v3.3.1 #1123

natilivni opened this issue Nov 16, 2022 · 3 comments

Comments

@natilivni
Copy link

natilivni commented Nov 16, 2022

Hello, can we expect support for spark v3.3.1?

@natilivni natilivni changed the title Support for spark v3.3.2 Support for spark v3.3.1 Nov 16, 2022
@GeorgeS2019
Copy link

GeorgeS2019 commented Feb 9, 2023

Dec 14 2022: Azure Synapse Runtime for Apache Spark 3.3 is now in Public Preview

  • Apache Spark to version 3.3.1
  • Delta Lake to version 2.1.0

Delta Lake version 2.1.0 Support for Apache Spark 3.3.

@dcosta91
Copy link

Hey,

We also require this package to support 3.3.
We are using it on Cloudera CDH-7.1.8, which has Spark version 3.3.2.
We are able to run our apps using Spark 2, but when trying to migrate to Spark3 we get this error:
User class threw exception: java.lang.IllegalArgumentException: Unsupported spark version used: '3.3.2.3.3.7180.12-5'. Normalized spark version used: '3.3.2'. Supported spark major.minor version: '3.2'.

Thanks a lot!

@GeorgeS2019
Copy link

@dcosta91
#1150

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants