观测GPU进程频繁开辟释放 解码速度很慢 #154
Unanswered
DingJuPeng1
asked this question in
Q&A
观测GPU进程频繁开辟释放 解码速度很慢
#154
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
使用llama_7B_hf 这个模型进行解码评测 观测nvidia-smi 里面显卡的使用会不断有进程开辟释放 八块a100 两个小时只解了300条 速度很慢 求助是否有设置上的问题
下图是模型设置
显卡观测
Beta Was this translation helpful? Give feedback.
All reactions