[Core][Performance] Add XGrammar support for guided decoding and set it as default #23132
Annotations
4 errors
|
|
|
Mypy:
vllm/model_executor/guided_decoding/xgrammar_decoding.py#L78
Name "logger" is not defined [name-defined]
|
|
Mypy:
vllm/model_executor/guided_decoding/xgrammar_decoding.py#L145
"None" not callable [misc]
|
|
Mypy
The operation was canceled.
|
Loading