Skip to content
This repository has been archived by the owner on Jun 14, 2024. It is now read-only.

Spark 3.1 on Windows build test issue #484

Open
clee704 opened this issue Jul 28, 2021 · 0 comments
Open

Spark 3.1 on Windows build test issue #484

clee704 opened this issue Jul 28, 2021 · 0 comments

Comments

@clee704
Copy link

clee704 commented Jul 28, 2021

Here's the logs: https://dev.azure.com/ossspark/78bda1b1-2d15-4e6d-8327-a916f6cb1f9f/_apis/build/builds/2223/logs/48

Newly added tests are failing only for Windows / Spark 3.1.

The exception is: java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat;

I suspect this is because Spark 3.1 depends on Hadoop 3.2.0 but we use 2.8.1 for testing.

clee704 pushed a commit to clee704/hyperspace that referenced this issue Jul 28, 2021
clee704 pushed a commit to clee704/hyperspace that referenced this issue Jul 28, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant