[Frontend] API support for beam search for MQLLMEngine#9117
Merged
youkaichao merged 13 commits intovllm-project:mainfrom LunrEclipse:beam-search-mq-refactorOct 8, 2024
+215-106
Commits
Commits on Oct 7, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- committed
Commits on Oct 8, 2024
- committed
- committed