Skip to content

[Bugfix] Support testing prefill throughput with benchmark_serving.py --hf-output-len 1#8891

Merged
ywang96 merged 2 commits intovllm-project:mainfrom heheda12345:benchmark_serving_prefillSep 28, 2024
+4-5

Commits