Skip to content

[Bugfix] spec decode handle None entries in topk args in create_sequence_group_output#7232

Merged
njhill merged 2 commits intovllm-project:mainfrom tjohnson31415:spec-decoding-logprobsAug 22, 2024

Commits

Commits on Aug 20, 2024