Skip to content

Commit

Permalink
Add HADOOP_CLASSPATH
Browse files Browse the repository at this point in the history
  • Loading branch information
ArmandoZ committed Feb 7, 2024
1 parent b54da6c commit 897cb95
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions .github/services/hdfs/hdfs_default_gcs/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -44,11 +44,14 @@ runs:
curl -LsSf -o ${HADOOP_HOME}/share/hadoop/common/lib/gcs-connector-hadoop3-2.2.19-shaded.jar https://github.com/GoogleCloudDataproc/hadoop-connectors/releases/download/v2.2.19/gcs-connector-hadoop3-2.2.19-shaded.jar
export HADOOP_CLASSPATH=${HADOOP_HOME}/share/hadoop/common/lib/gcs-connector-hadoop3-2.2.19-shaded.jar:$HADOOP_CLASSPATH
cp ./fixtures/hdfs/hdfs-site.xml ${HADOOP_HOME}/etc/hadoop/hdfs-site.xml
cp ./fixtures/hdfs/gcs-core-site.xml ${HADOOP_HOME}/etc/hadoop/core-site.xml
cat << EOF >> $GITHUB_ENV
HADOOP_HOME=${HADOOP_HOME}
HADOOP_CLASSPATH=${HADOOP_CLASSPATH}
CLASSPATH=${CLASSPATH}
LD_LIBRARY_PATH=${JAVA_HOME}/lib/server:${HADOOP_HOME}/lib/native
OPENDAL_HDFS_ROOT=${OPENDAL_GCS_ROOT}
Expand All @@ -60,3 +63,5 @@ runs:
echo ${OPENDAL_GCS_CREDENTIAL} | base64 -d > /tmp/hdfs/gcs-credentials.json
<value>/workspaces/opendal/tmp/quiet-vector.json</value>

0 comments on commit 897cb95

Please sign in to comment.