Skip to content

[BUGFIX] Raise an error for no draft token case when draft_tp>1#6369

Merged
simon-mo merged 13 commits intovllm-project:mainfrom wooyeonlee0:temporal-fix-skip-specJul 19, 2024