Skip to content

[Misc] add a flag max_batch_size_to_capture to reduce vllm's start up time #25688

[Misc] add a flag max_batch_size_to_capture to reduce vllm's start up time

[Misc] add a flag max_batch_size_to_capture to reduce vllm's start up time #25688

yapf (3.8)

succeeded Oct 25, 2024 in 2m 37s