Skip to content
Back to pull request #9686

[Misc] add a flag max_batch_size_to_capture to reduce vllm's start up time #19118

Sign in to view logs

[Misc] add a flag max_batch_size_to_capture to reduce vllm's start up time

[Misc] add a flag max_batch_size_to_capture to reduce vllm's start up time #19118

Triggered via pull request October 25, 2024 07:57
@sfc-gh-zhwangsfc-gh-zhwang
synchronize #9686
sfc-gh-zhwang:zhwang/max-batch-size-to-capture
Status Success
Total duration 53s
Artifacts –

mypy.yaml

on: pull_request
Matrix: mypy
Fit to window
Zoom out
Zoom in