Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pypi build for aarch64 #4978

Open
surak opened this issue Oct 23, 2024 · 4 comments
Open

Pypi build for aarch64 #4978

surak opened this issue Oct 23, 2024 · 4 comments

Comments

@surak
Copy link

surak commented Oct 23, 2024

Currently, the python wheels are for x86_64 only. It would be good to have them on arm as well.

@j93hahn
Copy link

j93hahn commented Oct 31, 2024

@surak follow the instructions to build from source, it worked very smoothly for me

@surak
Copy link
Author

surak commented Oct 31, 2024

@j93hahn Oh, I know how to build from source :-) But I don't want to do that for every version, at every supercomputer we have here with a different architecture :-)

@drikster80
Copy link

+1 for releasing an official aarch64 whl file in addition to the x86_64. This would help downstream projects such as VLLM provide official docker (vllm-project/vllm#10499) without the need to continuously rebuild and support a from-source build.

@Skylion007
Copy link

+1 I'm running into issues deploying this on an HPC cluster due to the difficulty with the getting the arm64 version compiled. It's the main blocker from me using GH200 style clusters.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants