New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

flash-attn安装失败 #76

Open

13659866563 opened this issue Jul 24, 2024 · 4 comments

13659866563 commented Jul 24, 2024

mikck commented Jul 25, 2024

same

sun-shining commented Aug 1, 2024

Check your CUDA version. It seems you have installed it on a CentOS machine. The package flash-attn==2.6.2 requires CUDA 12+ to function properly.

yuhp-zts commented Oct 15, 2024

You can install this package separately. I solved the problem using this method.
pip install flash-attn==2.6.3
poetry install

ZhuShentian commented Nov 7, 2024

same error.cuda is installed on my ubuntu22.04:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment