Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Closes #1426: Run IIS experiments by relying on spark 3.4 version
WIP. Removing `provided` scope from the `spark-avro_2.12` dependency until making it part of sharelib342. Introducing required fixes for `eu/dnetlib/iis/wf/export/actionmanager/relation/citation/default` integration test to let it run relying on spark3: * setting `spark.extraListeners` and `spark.sql.queryExecutionListeners` explicitly to empty values in order to avoid relying on incompatible, spark2 compliant, cloudera listeners * setting `spark.shuffle.useOldFetchProtocol=true` to address `2.4 to 3.0 migration guide` requirement regarding protocol for fetching shuffle blocks backward compatibility (and avoiding `IllegalArgumentException: Unexpected message type: <number>` kind of errors)
- Loading branch information