Skip to content

Pull requests: vllm-project/vllm

New pull request New
309 Open 2,222 Closed
309 Open 2,222 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[ci][misc] fix more device count perf-benchmarks
#6055 opened Jul 2, 2024 by youkaichao Loading…
@DarkLight1337
3
[WIP][Kernel] Unify the kernel used in flash attention backend
#6052 opened Jul 2, 2024 by LiuXiaoxuanPKU • Draft
1
[Kernel][Model] logits_soft_cap for Gemma2 with flashinfer
#6051 opened Jul 1, 2024 by LiuXiaoxuanPKU Loading…
@comaniac
2
Benchmark: add H100 suite perf-benchmarks
#6047 opened Jul 1, 2024 by simon-mo Loading…
1
Create guided_decoding.md
#6045 opened Jul 1, 2024 by w013nad Loading…
2
[ROCm][AMD][Model]Adding alibi slopes support in ROCm triton flash attention and naive flash attention
#6043 opened Jul 1, 2024 by gshtras Loading…
[Kernel] Support Microsoft Runtime Kernel Lib for our Low Precision Computation
#6036 opened Jul 1, 2024 by LeiWang1999 • Draft
2 tasks
5
[Bugfix] Make spec. decode respect per-request seed.
#6034 opened Jul 1, 2024 by tdoublep Loading…
1
13
[wip][Core] Introduce SPMD worker execution using Ray accelerated DAG
#6032 opened Jul 1, 2024 by ruisearch42 • Draft
Support for quantized kv cache (compressed-tensors)
#6028 opened Jul 1, 2024 by dbogunowicz Loading…
5
model test with cache
#6024 opened Jul 1, 2024 by khluu • Draft
Test HF cache
#6016 opened Jul 1, 2024 by khluu • Draft
[core]fix prompt limit
#6014 opened Jul 1, 2024 by jikunshang Loading…
2
[Distributed][Hardware][Intel CPU][Intel GPU]fix tp issues on xpu and cpu x86 CPU
#6013 opened Jul 1, 2024 by jikunshang Loading…
[ci][distributed] add distributed test gptq_marlin with tp = 2
#6010 opened Jul 1, 2024 by llmpros Loading…
8
[Hardware][Intel CPU] Adding intel openmp tunings in Docker file x86 CPU
#6008 opened Jul 1, 2024 by zhouyuan Loading…
[Feature][Hardware][AMD] Enable Scaled FP8 GEMM on ROCm rocm
#6006 opened Jun 30, 2024 by HaiShaw Loading…
2
[Doc] Update description of vLLM support for CPUs x86 CPU
#6003 opened Jun 30, 2024 by DamonFool Loading…
3
[Frontend] Add bad_words_ids sampling parameter
#5986 opened Jun 29, 2024 by Alvant Loading…
1
5
[wip][Core] Introduce SPMD worker execution using Ray accelerated DAG
#5980 opened Jun 29, 2024 by stephanie-wang • Draft
3 tasks
[misc][doc] try to add warning for latest html
#5979 opened Jun 29, 2024 by youkaichao Loading…
4
[Kernel] Expand FP8 support to Ampere GPUs using FP8 Marlin
#5975 opened Jun 28, 2024 by mgoin Loading…
1
[Draft][Core] Refactor _prepare_model_input_tensors
#5972 opened Jun 28, 2024 by comaniac • Draft
1
[ Misc ] Refactor MoE to isolate Fp8 From Mixtral
#5970 opened Jun 28, 2024 by robertgshaw2-neuralmagic Loading…
18
[misc][optimization] optimize data structure in allocator
#5968 opened Jun 28, 2024 by youkaichao Loading…
36
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.