Skip to content
Back to pull request #9686

[Misc] add a flag max_batch_size_to_capture to reduce vllm's start up time #19118

Sign in to view logs

[Misc] add a flag max_batch_size_to_capture to reduce vllm's start up time

[Misc] add a flag max_batch_size_to_capture to reduce vllm's start up time #19118

mypy (3.10)

mypy (3.10)
succeeded Oct 25, 2024 in 28s