Skip to content

[V1] Refactor LLMEngine To Use Multiprocessing #19317

[V1] Refactor LLMEngine To Use Multiprocessing

[V1] Refactor LLMEngine To Use Multiprocessing #19317

Triggered via pull request October 27, 2024 22:34
Status Failure
Total duration 29s
Artifacts

mypy.yaml

on: pull_request
Matrix: mypy
Fit to window
Zoom out
Zoom in

Annotations

19 errors
mypy (3.11): vllm/entrypoints/llm.py#L906
"LLMEngine" has no attribute "get_num_unfinished_requests" [attr-defined]
mypy (3.11): vllm/entrypoints/llm.py#L919
"LLMEngine" has no attribute "has_unfinished_requests" [attr-defined]
mypy (3.11)
Process completed with exit code 1.
mypy (3.10)
The job was canceled because "_3_11" failed.
mypy (3.10): vllm/entrypoints/llm.py#L906
"LLMEngine" has no attribute "get_num_unfinished_requests" [attr-defined]
mypy (3.10): vllm/entrypoints/llm.py#L919
"LLMEngine" has no attribute "has_unfinished_requests" [attr-defined]
mypy (3.10)
Process completed with exit code 1.
mypy (3.12)
The job was canceled because "_3_11" failed.
mypy (3.12): vllm/entrypoints/llm.py#L906
"LLMEngine" has no attribute "get_num_unfinished_requests" [attr-defined]
mypy (3.8)
The job was canceled because "_3_11" failed.
mypy (3.12): vllm/entrypoints/llm.py#L919
"LLMEngine" has no attribute "has_unfinished_requests" [attr-defined]
mypy (3.12)
The operation was canceled.
mypy (3.8): vllm/entrypoints/llm.py#L906
"LLMEngine" has no attribute "get_num_unfinished_requests" [attr-defined]
mypy (3.8): vllm/entrypoints/llm.py#L919
"LLMEngine" has no attribute "has_unfinished_requests" [attr-defined]
mypy (3.8)
The operation was canceled.
mypy (3.9)
The job was canceled because "_3_11" failed.
mypy (3.9): vllm/entrypoints/llm.py#L906
"LLMEngine" has no attribute "get_num_unfinished_requests" [attr-defined]
mypy (3.9): vllm/entrypoints/llm.py#L919
"LLMEngine" has no attribute "has_unfinished_requests" [attr-defined]
mypy (3.9)
The operation was canceled.