-
Notifications
You must be signed in to change notification settings - Fork 28.6k
[SPARK-22866] [K8S] Fix path issue in Kubernetes dockerfile #20051
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
The path was recently changed in apache#19946, but the dockerfile was not updated.
@@ -38,7 +38,7 @@ COPY jars /opt/spark/jars | |||
COPY bin /opt/spark/bin | |||
COPY sbin /opt/spark/sbin | |||
COPY conf /opt/spark/conf | |||
COPY dockerfiles/spark-base/entrypoint.sh /opt/ | |||
COPY kubernetes/dockerfiles/spark-base/entrypoint.sh /opt/ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, to elaborate, on our fork, we used to have dockerfiles/
in the root of the built distribution. But now, it's copied to kubernetes/dockerfiles
which is a more logical place, since there is a yarn/
in the distribution as well.
A grep indicates this is the full list:
|
@mridulm thanks for looking into it! Looks like I missed updating the dockerfile comments. On it. |
Done, comments updated. I'm setting up CI on the Kubernetes test infrastructure this week - should help catch these issues early on in future. |
Merged, thanks @foxish |
Test build #85294 has finished for PR 20051 at commit
|
Test build #85297 has finished for PR 20051 at commit
|
What changes were proposed in this pull request?
The path was recently changed in #19946, but the dockerfile was not updated.
This is a trivial 1 line fix.
How was this patch tested?
./sbin/build-push-docker-images.sh -r spark-repo -t latest build
cc/ @vanzin @mridulm @rxin @jiangxb1987 @liyinan926