Activity
update
update
update controller
update controller
[ Misc ] Remove separate bias add (vllm-project#6353)
[ Misc ] Remove separate bias add (vllm-project#6353)
Fix w8a8 benchmark and add Llama-3-8B (vllm-project#5562)
Fix w8a8 benchmark and add Llama-3-8B (vllm-project#5562)
[Core][Bugfix]: fix prefix caching for blockv2
[Core][Bugfix]: fix prefix caching for blockv2
update
update
add spec infer related into prometheus metrics.
add spec infer related into prometheus metrics.
Force push
[Misc] Make Serving Benchmark More User-friendly (vllm-project#5044)
[Misc] Make Serving Benchmark More User-friendly (vllm-project#5044)
add comment
add comment
reuse ServerRunner
reuse ServerRunner
fix ruff
fix ruff
fix ruff
fix ruff
Add control panel allow manage multi vllm instances
Add control panel allow manage multi vllm instances
[Core][Bugfix]: fix prefix caching for blockv2
[Core][Bugfix]: fix prefix caching for blockv2
assert ref count inc after promotion
assert ref count inc after promotion
fix ruff
fix ruff
[Core][Bugfix]: fix prefix caching for blockv2
[Core][Bugfix]: fix prefix caching for blockv2
Deleted branch
fix spelling
fix spelling
[Core][Bugfix]: fix prefix caching for blockv2
[Core][Bugfix]: fix prefix caching for blockv2
[Core][Test] fix function name typo in custom allreduce (vllm-project…
[Core][Test] fix function name typo in custom allreduce (vllm-project…
Updated branch
Force pushMissing commit
[Doc] Chunked Prefill Documentation (vllm-project#4580)
[Doc] Chunked Prefill Documentation (vllm-project#4580)
Updated branch
Missing commit
logging proposer type
logging proposer type
fix
fix