New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

llama2-13B和llama2-70b所需要的显卡配置 #3

Open

batindfa opened this issue Aug 9, 2023 · 1 comment

batindfa commented Aug 9, 2023

您好！需要多少显卡呀？

Contributor

little51 commented Aug 9, 2023

我没有试过。按7B的推算，13B半精度应该需要24G显存的显卡，全精度需要32G显存，70B得A100（80G），而且得多块卡。因为我手头没有大显存设备，所以也不能给出精确的配置，建议在阿里云按小时开GPU主机测试。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment