[V1] Refactor LLMEngine To Use Multiprocessing #19317
Annotations
4 errors
|
|
|
vllm/entrypoints/llm.py#L906
"LLMEngine" has no attribute "get_num_unfinished_requests" [attr-defined]
|
|
vllm/entrypoints/llm.py#L919
"LLMEngine" has no attribute "has_unfinished_requests" [attr-defined]
|
|
|
This job was cancelled
Loading