[V1] Refactor LLMEngine To Use Multiprocessing #19317
Annotations
19 errors
mypy (3.11):
vllm/entrypoints/llm.py#L906
"LLMEngine" has no attribute "get_num_unfinished_requests" [attr-defined]
|
mypy (3.11):
vllm/entrypoints/llm.py#L919
"LLMEngine" has no attribute "has_unfinished_requests" [attr-defined]
|
mypy (3.11)
Process completed with exit code 1.
|
mypy (3.10)
The job was canceled because "_3_11" failed.
|
mypy (3.10):
vllm/entrypoints/llm.py#L906
"LLMEngine" has no attribute "get_num_unfinished_requests" [attr-defined]
|
mypy (3.10):
vllm/entrypoints/llm.py#L919
"LLMEngine" has no attribute "has_unfinished_requests" [attr-defined]
|
mypy (3.10)
Process completed with exit code 1.
|
mypy (3.12)
The job was canceled because "_3_11" failed.
|
mypy (3.12):
vllm/entrypoints/llm.py#L906
"LLMEngine" has no attribute "get_num_unfinished_requests" [attr-defined]
|
mypy (3.8)
The job was canceled because "_3_11" failed.
|
mypy (3.12):
vllm/entrypoints/llm.py#L919
"LLMEngine" has no attribute "has_unfinished_requests" [attr-defined]
|
mypy (3.12)
The operation was canceled.
|
mypy (3.8):
vllm/entrypoints/llm.py#L906
"LLMEngine" has no attribute "get_num_unfinished_requests" [attr-defined]
|
mypy (3.8):
vllm/entrypoints/llm.py#L919
"LLMEngine" has no attribute "has_unfinished_requests" [attr-defined]
|
mypy (3.8)
The operation was canceled.
|
mypy (3.9)
The job was canceled because "_3_11" failed.
|
mypy (3.9):
vllm/entrypoints/llm.py#L906
"LLMEngine" has no attribute "get_num_unfinished_requests" [attr-defined]
|
mypy (3.9):
vllm/entrypoints/llm.py#L919
"LLMEngine" has no attribute "has_unfinished_requests" [attr-defined]
|
mypy (3.9)
The operation was canceled.
|