Skip to content

[Bugfix] Fix block table for seqs that have prefix cache hits#7018

Merged
WoosukKwon merged 5 commits intovllm-project:mainfrom zachzzc:fix_prefix_cache_block_tableAug 3, 2024

Commits

Commits on Aug 1, 2024

Commits on Aug 2, 2024