Skip to content

[Speculative Decoding] Fixing hidden states handling in batch expansion#7508

Merged
cadedaniel merged 6 commits intovllm-project:mainfrom flipkart-incubator:hidden_states_fixAug 20, 2024
+139-41

Commits