Skip to content

[Core][Performance] Add XGrammar support for guided decoding and set it as default #23135

[Core][Performance] Add XGrammar support for guided decoding and set it as default

[Core][Performance] Add XGrammar support for guided decoding and set it as default #23135

Triggered via pull request November 30, 2024 00:13
Status Failure
Total duration 51s
Artifacts

mypy.yaml

on: pull_request
Matrix: mypy
Fit to window
Zoom out
Zoom in

Annotations

19 errors
mypy (3.9): vllm/model_executor/guided_decoding/xgrammar_decoding.py#L83
Name "logger" is not defined [name-defined]
mypy (3.9): vllm/model_executor/guided_decoding/xgrammar_decoding.py#L128
Name "boolean" is not defined [name-defined]
mypy (3.9): vllm/model_executor/guided_decoding/xgrammar_decoding.py#L179
Item "None" of "Optional[Any]" has no attribute "to" [union-attr]
mypy (3.9)
Process completed with exit code 1.
mypy (3.12)
The job was canceled because "_3_9" failed.
mypy (3.12): vllm/model_executor/guided_decoding/xgrammar_decoding.py#L83
Name "logger" is not defined [name-defined]
mypy (3.12): vllm/model_executor/guided_decoding/xgrammar_decoding.py#L128
Name "boolean" is not defined [name-defined]
mypy (3.12): vllm/model_executor/guided_decoding/xgrammar_decoding.py#L179
Item "None" of "Any | None" has no attribute "to" [union-attr]
mypy (3.12)
Process completed with exit code 1.
mypy (3.10)
The job was canceled because "_3_9" failed.
mypy (3.10): vllm/model_executor/guided_decoding/xgrammar_decoding.py#L83
Name "logger" is not defined [name-defined]
mypy (3.10): vllm/model_executor/guided_decoding/xgrammar_decoding.py#L128
Name "boolean" is not defined [name-defined]
mypy (3.10): vllm/model_executor/guided_decoding/xgrammar_decoding.py#L179
Item "None" of "Any | None" has no attribute "to" [union-attr]
mypy (3.10)
The operation was canceled.
mypy (3.11)
The job was canceled because "_3_9" failed.
mypy (3.11): vllm/model_executor/guided_decoding/xgrammar_decoding.py#L83
Name "logger" is not defined [name-defined]
mypy (3.11): vllm/model_executor/guided_decoding/xgrammar_decoding.py#L128
Name "boolean" is not defined [name-defined]
mypy (3.11): vllm/model_executor/guided_decoding/xgrammar_decoding.py#L179
Item "None" of "Any | None" has no attribute "to" [union-attr]
mypy (3.11)
The operation was canceled.