Skip to content

[Bugfix] Generate multiple different prompts in benchmark_prefix_caching.py based on --num-prompts#9687

Open
heheda12345 wants to merge 2 commits intovllm-project:mainfrom heheda12345:benchmark_prefix_cache_fix
+13-4

Commits

Commits on Oct 25, 2024