Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Jan 27, 2025

• [V1][Minor] Minor optimizations for update_from_output (vllm-project#12454)

  Show description for 624a1e4
  WoosukKwon

  authored
  624a1e4

  Copy full SHA for 624a1e4

• [Bugfix] Fix missing seq_start_loc in xformers prefill metadata (vllm-project#12464)

  Show description for 372bf08
  Isotr0py

  authored
  372bf08

  Copy full SHA for 372bf08

• [Bugfix] Fix Granite 3.0 MoE model loading (vllm-project#12446)

  Show description for 5204ff5
  DarkLight1337

  authored
  5204ff5

  Copy full SHA for 5204ff5

• [Frontend] Support scores endpoint in run_batch (vllm-project#12430)

  Show description for 0cc6b38
  pooyadavoodi

  authored
  0cc6b38

  Copy full SHA for 0cc6b38

• [V1] Avoid list creation in input preparation (vllm-project#12457)

  Show description for 28e0750
  WoosukKwon

  authored
  28e0750

  Copy full SHA for 28e0750

• [DOC] Add link to vLLM blog (vllm-project#12460)

  Show description for 582cf78
  terrytangyuan

  authored
  582cf78

  Copy full SHA for 582cf78

• [Frontend] Rerank API (Jina- and Cohere-compatible API) (vllm-project#12376)

  Show description for 0034b09
  K-Mistele

  authored
  0034b09

  Copy full SHA for 0034b09

Commits on Jan 26, 2025

• [Build/CI] Fix libcuda.so linkage (vllm-project#12424)

  Show description for 72bac73
  tlrmchlsmth

  authored
  72bac73

  Copy full SHA for 72bac73

• [Bugfix][Kernel] Fix perf regression caused by PR vllm-project#12405 (vllm-project#12434)

  Show description for 68f1114
  LucasWilkinson

  authored
  68f1114

  Copy full SHA for 68f1114

• [Bugfix/CI] Fix broken kernels/test_mha.py (vllm-project#12450)

  tlrmchlsmth

  authored
  72f4880

  Copy full SHA for 72f4880

• [Bugfix] Disable w16a16 2of4 sparse CompressedTensors24 (vllm-project#12417)

  Show description for aa2cd2c
  

  tlrmchlsmth

  and

  mgoin

  authored
  aa2cd2c

  Copy full SHA for aa2cd2c

• [Frontend] generation_config.json for maximum tokens(vllm-project#12242)

  Show description for 9ddc352
  

  9 peopleauthored
  9ddc352

  Copy full SHA for 9ddc352

• [Misc] Revert FA on ViT vllm-project#12355 and vllm-project#12435 (vllm-project#12445)

  ywang96

  authored
  a525527

  Copy full SHA for a525527

• [V1][Bugfix] Fix assertion when mm hashing is turned off (vllm-project#12439)

  Show description for 0ee349b
  ywang96

  authored
  0ee349b

  Copy full SHA for 0ee349b

• [V1][Perf] Reduce scheduling overhead in model runner after cuda sync (vllm-project#12094)

  Show description for fa63e71
  youngkent

  authored
  fa63e71

  Copy full SHA for fa63e71

• [Misc][Bugfix] FA3 support to ViT MHA layer (vllm-project#12435)

  Show description for 2a0309a
  

  ywang96

  and

  Isotr0py

  authored
  2a0309a

  Copy full SHA for 2a0309a

Commits on Jan 25, 2025

• [TPU][CI] Update torchxla version in requirement-tpu.txt (vllm-project#12422)

  Show description for 324960a
  lsy323

  authored
  324960a

  Copy full SHA for 324960a

• [Misc] Add FA2 support to ViT MHA layer (vllm-project#12355)

  Show description for f1fc051
  Isotr0py

  authored
  f1fc051

  Copy full SHA for f1fc051

• [ROCm][MoE] MI300 tuned configs Mixtral-8x(7B,22B) | fp16, fp8 (vllm-project#12408)

  Show description for bf21481
  divakar-amd

  authored
  bf21481

  Copy full SHA for bf21481

• [Bugfix] Fix BLIP-2 processing (vllm-project#12412)

  Show description for fb30ee9
  DarkLight1337

  authored
  fb30ee9

  Copy full SHA for fb30ee9

• [Bugfix][Kernel] Fix moe align block issue for mixtral (vllm-project#12413)

  ElizaWszola

  authored
  221d388

  Copy full SHA for 221d388

Commits on Jan 24, 2025

• [Bugfix][Kernel] FA3 Fix - RuntimeError: This flash attention build only supports pack_gqa (for build size reasons). (vllm-project#12405)

  Show description for 3132a93
  LucasWilkinson

  authored
  3132a93

  Copy full SHA for 3132a93

• [Misc] Remove deprecated code (vllm-project#12383)

  Show description for df5dafa
  DarkLight1337

  authored
  df5dafa

  Copy full SHA for df5dafa

• [Bugfix][Kernel] Fix CUDA 11.8 being broken by FA3 build (vllm-project#12375)

  Show description for ab5bbf5
  LucasWilkinson

  authored
  ab5bbf5

  Copy full SHA for ab5bbf5

• [Misc] Enable proxy support in benchmark script (vllm-project#12356)

  Show description for 3bb8e2c
  jsato8094

  authored
  3bb8e2c

  Copy full SHA for 3bb8e2c

• [ci/build] sync default value for wheel size (vllm-project#12398)

  Show description for e784c6b
  youkaichao

  authored
  e784c6b

  Copy full SHA for e784c6b

• [Hardware][Gaudi][Doc] Add missing step in setup instructions (vllm-project#12382)

  MohitIntel

  authored
  9a0f3bd

  Copy full SHA for 9a0f3bd

• [ci/build] fix wheel size check (vllm-project#12396)

  Show description for c7c9851
  youkaichao

  authored
  c7c9851

  Copy full SHA for c7c9851

• [Misc] Use VisionArena Dataset for VLM Benchmarking (vllm-project#12389)

  Show description for 3c818bd
  ywang96

  authored
  3c818bd

  Copy full SHA for 3c818bd

• [perf] fix perf regression from vllm-project#12253 (vllm-project#12380)

  Show description for 6dd94db
  youkaichao

  authored
  6dd94db

  Copy full SHA for 6dd94db

• [V1] Increase default batch size for H100/H200 (vllm-project#12369)

  Show description for 0e74d79
  WoosukKwon

  authored
  0e74d79

  Copy full SHA for 0e74d79

• Update compressed-tensors version (vllm-project#12367)

  dsikka

  authored
  55ef66e

  Copy full SHA for 55ef66e

• [Bugfix] Path join when building local path for S3 clone (vllm-project#12353)

  Show description for 5e5630a
  omer-dayan

  authored
  5e5630a

  Copy full SHA for 5e5630a

• Set weights_only=True when using torch.load() (vllm-project#12366)

  Show description for d3d6bb1
  russellb

  authored
  d3d6bb1

  Copy full SHA for d3d6bb1

• [V1][Frontend] Coalesce bunched RequestOutputs (vllm-project#12298)

  Show description for 24b0205
  

  njhill

  and

  robertgshaw2-redhat

  authored
  24b0205

  Copy full SHA for 24b0205

Pagination

Previous

Next