Releases: AbsaOSS/ABRiS
ABRiS 6.4.1
ABRiS 6.4.0
Tickets
- Handle malformed records by providing a PermissiveRecordExceptionHandler by @willianmrs in #328
- Support upcoming constructor change in Spark 3.5.1-SNAPSHOT by @kevinwallimann in #353
Other
- Add code coverage support by @miroslavpojer in #314
- Add Permissions to JaCoCo GH action by @Zejnilovic in #330
- Update jacoco-report by @cerveada in #332
- Move permissions to job level by @kevinwallimann in #333
- Use pull_request_target to fix PRs from forks by @cerveada in #334
- Split code coverage and test GitHub actions by @cerveada in #340
- Fix tests for Spark 3.5.0 by @kevinwallimann in #351
New Contributors
- @miroslavpojer made their first contribution in #314
- @Zejnilovic made their first contribution in #330
- @willianmrs made their first contribution in #328
Full Changelog: v6.3.0...v6.4.0
ABRiS 6.3.0
Tickets
- Adding exception handlers by @ScaddingJ in #290
- Fix scalastyle by @kevinwallimann in #292
- Add intellij entries in .editorconfig by @cerveada in #297
New Contributors
- @ScaddingJ made their first contribution in #290
Full Changelog: v6.2.0...v6.3.0
ABRiS 6.2.0
ABRiS 6.1.1
ABRiS 5.1.1
ABRiS 6.1.0
Tickets
- Make schema converter configurable by @kevinwallimann in #268
Full Changelog: v6.0.0...v6.1.0
ABRiS 5.1.0
Tickets
- Deprecation fixes by @cerveada in #261
- Make schema converter configurable by @kevinwallimann in #269
Full Changelog: v5.0.0...v5.1.0
ABRiS 6.0.0
This version adds support for Spark 3.2 and Confluent 6.2.0. Support for Scala 2.13 was added as well.
Please note that this version is not compatible with older versions of Spark.
Tickets
- Spark 3.2 support by @cerveada in #248
- Support for Scala 2.13 by @cerveada in #260
- Update Confluent to not-deprecated methods by @kevinwallimann in #262
Full Changelog: v5.0.0...v6.0.0
ABRiS 5.0.0
The main improvements in this version are
- Improved compatibility with Spark 3.0 and 3.1
- Compatibility with Spark-Avro 2.4 and newer
- When converting to Avro, Abris uses spark-avro methods when possible
The changes are mostly internal, and the user interface of the library was not changed from version 4. There might be some changes in the behavior since conversion to Avro is now handled by spark-avro methods directly. But this is desired since we don't want to differ from the spark-avro library in this - Abris aims to just add an additional layer of support for confluent schema format and schema registry support.
Tickets
- making FromAvroConfig and ToAvroConfig classes serializable by @yokhan-dukhin in #229
- Abris #230 improve exception message and comments by @cerveada in #231
- Abris #237 add Spark 3.1 profile and automatic test config by @cerveada in #238
- Abris #242 remove dependency on confluent naming strategy code by @cerveada in #243
- Abris #240 use spark avro encoder writer by @cerveada in #241
- Abris #246 support for multiple spark avro by @cerveada in #247
- Abris #159 add developer api annotations by @cerveada in #251
New Contributors
- @yokhan-dukhin made their first contribution in #229
Full Changelog: v4.2.0...v5.0.0