[Core][Performance] Add XGrammar support for guided decoding and set it as default #23135
Annotations
5 errors
|
|
|
Mypy:
vllm/model_executor/guided_decoding/xgrammar_decoding.py#L83
Name "logger" is not defined [name-defined]
|
|
Mypy:
vllm/model_executor/guided_decoding/xgrammar_decoding.py#L128
Name "boolean" is not defined [name-defined]
|
|
Mypy:
vllm/model_executor/guided_decoding/xgrammar_decoding.py#L179
Item "None" of "Any | None" has no attribute "to" [union-attr]
|
|
Mypy
The operation was canceled.
|
Loading