Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

gunicorn多worker情况下，使用vgpu出现死锁 #588

Open
xiaoyu1095 opened this issue Nov 1, 2024 · 1 comment
Open

gunicorn多worker情况下，使用vgpu出现死锁 #588

xiaoyu1095 opened this issue Nov 1, 2024 · 1 comment
Labels
kind/bug Something isn't working

Comments

@xiaoyu1095
Copy link

稳定复现：
使用gunicorn启动SentenceTransformer拉起embeeding模型，（会根据worker数量，同时启动多个相同服务进程）
会卡住在SentenceTransformer(path)实例化处，后pod因为探针原因会被kill掉，重启的实例会输出unified_lock locked, waiting 1 second...

302277e0b48a3c85505e1fe323e629ea
@xiaoyu1095 xiaoyu1095 added the kind/bug Something isn't working label Nov 1, 2024
@xiaoyu1095 xiaoyu1095 reopened this Nov 1, 2024
@wawa0210
Copy link
Member

wawa0210 commented Nov 4, 2024

Can you describe your usage scenario in detail? Provide the corresponding version, node resource status, application yaml and other information

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind/bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@wawa0210 @xiaoyu1095