Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support kaniko - incluster builds #78

Open
jlewi opened this issue Mar 19, 2024 · 1 comment
Open

Support kaniko - incluster builds #78

jlewi opened this issue Mar 19, 2024 · 1 comment

Comments

@jlewi
Copy link
Owner

jlewi commented Mar 19, 2024

Now that we have code for building the context launching as a Job running kaniko in K8s should be relatively straightforward.

Possible advantages of using K8s

  • Pools of available resources
  • More resources (in particular RAM) than what's available in GCB

This PR has some YAML for launching kaniko on k8s
jlewi/notes#12

@jlewi
Copy link
Owner Author

jlewi commented Mar 20, 2024

Not sure how useful this would be.
It looks like kaniko has a dependency on ephmeral-storage GoogleContainerTools/kaniko#2219. I think on GKE clusters this maxes out at 10Gi on standard clusters and 1Gi on Autopilot clusters. This turns out to be too low for really big images like CUDA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant