We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
IIRC, no other change besides this. It's ok with one GPU. BTW what's the difference bwtween actual_gpu_num and gpu_num
actual_gpu_num
gpu_num
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Problems when use 2 A800 GPU serving LLaMA-3-8B
IIRC, no other change besides this. It's ok with one GPU. BTW what's the difference bwtween
actual_gpu_num
andgpu_num
The text was updated successfully, but these errors were encountered: