We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
本地部署的模型切换时,如果不等模型A分配到显卡上就切换另外一个模型B,会导致显示B而实际上调用A 是否可以在部署模型时禁止用户切换模型?或者放弃当前的部署,转而部署新的模型
1.正常完成本地部署 2.切换qwen-7b-chat模型时,没有等待模型分配到显卡上就切换模型qwen-14b-chat 3.实际回复时仍然调用的是qwen-7b-chat
No response
The text was updated successfully, but these errors were encountered:
Keldos-Li
No branches or pull requests
这个bug是否已存在现有issue了?
错误表现
本地部署的模型切换时,如果不等模型A分配到显卡上就切换另外一个模型B,会导致显示B而实际上调用A
是否可以在部署模型时禁止用户切换模型?或者放弃当前的部署,转而部署新的模型
复现操作
1.正常完成本地部署
2.切换qwen-7b-chat模型时,没有等待模型分配到显卡上就切换模型qwen-14b-chat
3.实际回复时仍然调用的是qwen-7b-chat
错误日志
No response
运行环境
帮助解决
补充说明
No response
The text was updated successfully, but these errors were encountered: