Skip to content

Pull requests: vllm-project/vllm

New pull request New
688 Open 8,779 Closed
688 Open 8,779 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add DeepSeek-R1-0528 function call chat template documentation Improvements or additions to documentation tool-calling
#18874 opened May 29, 2025 by Xu-Wenqing • Draft
1
[doc] add CLI doc documentation Improvements or additions to documentation
#18871 opened May 29, 2025 by reidliu41 Loading…
2
Fix AOPerModuleConfig name changes
#18869 opened May 29, 2025 by jerryzh168 Loading…
6
[Kernel] Fix fp8 support for pplx and BatchedTritonExperts. v1
#18864 opened May 28, 2025 by bnellnm • Draft
2
[Model] NemotronH support documentation Improvements or additions to documentation
#18863 opened May 28, 2025 by vegaluisjose Loading…
3
[Core] Cast multimodal input in hf processor multi-modality Related to multi-modality (#4194) speculative-decoding tpu Related to Google TPUs v1
#18862 opened May 28, 2025 by lgeiger Loading…
6
[Bugfix] Remove NVFP4 scales assertions to fix load_format=dummy
#18861 opened May 28, 2025 by mgoin Loading…
3
[Bugfix] Ensure tensors are contiguous during serialisation ready ONLY add when PR is ready to merge/full CI is needed v1
#18860 opened May 28, 2025 by lgeiger Loading…
5
Account for memory usage of other processes v1
#18858 opened May 28, 2025 by maxdebayser Loading…
1
1
Revert "[Core] Improve Tensor serialisation (#18774)" ready ONLY add when PR is ready to merge/full CI is needed v1
#18857 opened May 28, 2025 by njhill • Draft
2
Fixes a dead link in nightly benchmark readme ci/build ready ONLY add when PR is ready to merge/full CI is needed
#18856 opened May 28, 2025 by nerdalert Loading…
2
Fix an error in dummy weight loading for quantization models
#18855 opened May 28, 2025 by Chenyaaang Loading…
1
test needs-rebase
#18848 opened May 28, 2025 by davidxia • Draft
2
[Spec Decode][Benchmark] Generalize spec decode offline benchmark to more methods and datasets documentation Improvements or additions to documentation
#18847 opened May 28, 2025 by ekagra-ranjan Loading…
2
Use standalone_compile by default in torch >= 2.8.0 ready ONLY add when PR is ready to merge/full CI is needed
#18846 opened May 28, 2025 by zou3519 Loading…
2
[Bugfix] Fix misleading information in the documentation documentation Improvements or additions to documentation
#18845 opened May 28, 2025 by jeejeelee Loading…
1
[Perf] Tune scaled_fp8_quant by increasing vectorization performance Performance-related issues ready ONLY add when PR is ready to merge/full CI is needed
#18844 opened May 28, 2025 by mgoin Loading…
8
[LoRA] Add LoRA support for InternVL ready ONLY add when PR is ready to merge/full CI is needed
#18842 opened May 28, 2025 by jeejeelee Loading…
1
2
Updating the incremental de-tokenizer v1
#18840 opened May 28, 2025 by ArthurZucker Loading…
1
[P/D] Heterogeneous TP v1
#18833 opened May 28, 2025 by NickLucche Loading…
3
[Misc] Split monolithic config.py into domain-specific modules needs-rebase ready ONLY add when PR is ready to merge/full CI is needed
#18830 opened May 28, 2025 by jeejeelee Loading…
3
[Bugfix] AssertionError when releasing waiting requests without KV cache allocation v1
#18829 opened May 28, 2025 by Abatom Loading…
6
[P/D][Misc] Enable profiling in disagg setup v1
#18827 opened May 28, 2025 by NickLucche Loading…
1
[FEAT][ROCm] Add AITER grouped topk for DeepSeekV2 rocm Related to AMD ROCm
#18825 opened May 28, 2025 by vllmellm Loading…
1
[Misc] refactor: simplify EngineCoreClient.make_async_mp_client in AsyncLLM v1
#18817 opened May 28, 2025 by googs1025 Loading…
5
ProTip! Adding no:label will show everything without a label.