Commits

Branch selector

 main

User selector

All users

Datepicker

All time

Commit History

Commits on Dec 23, 2024

• [V1] TP Ray executor (vllm-project#11107)

  Show description for a491d6f
  ruisearch42

  authored
  a491d6f

• [Docs] Convert rST to MyST (Markdown) (vllm-project#11145)

  Show description for 32aa205
  rafvasq

  authored
  32aa205

• [Doc] Fix typo in the help message of '--guided-decoding-backend' (vllm-project#11440)

  yansh97

  authored
  94d545a

• [Bugfix] Add kv cache scales to gemma2.py (vllm-project#11269)

  mgoin

  authored
  60fb4f3

• [CI] Expand OpenAI test_chat.py guided decoding tests (vllm-project#11048)

  Show description for 63afbe9
  mgoin

  authored
  63afbe9

• [Misc] add w8a8 asym models (vllm-project#11075)

  dsikka

  authored
  8cef6e0

• [Misc] Add assertion and helpful message for marlin24 compressed models (vllm-project#11388)

  dsikka

  authored
  b866cdb

• [Bugfix] torch nightly version in ROCm installation guide (vllm-project#11423)

  Show description for 2e72668
  terrytangyuan

  authored
  2e72668

• [Bugfix] Fix CFGGuide and use outlines for grammars that can't convert to GBNF (vllm-project#11389)

  Show description for 5bfb30a
  mgoin

  authored
  5bfb30a

• mypy type checking for vllm/worker (vllm-project#11418)

  Show description for e51719a
  

  lucas-tucker

  and

  lucast2021

  authored
  e51719a

• [misc][perf] remove old code (vllm-project#11425)

  Show description for f30581c
  youkaichao

  authored
  f30581c

Commits on Dec 22, 2024

• [CI] Unboock H100 Benchmark (vllm-project#11419)

  Show description for 048fc57
  simon-mo

  authored
  048fc57

• [Bugfix] Fix fully sharded LoRAs with Mixtral (vllm-project#11390)

  Show description for f1d1bf6
  n1hility

  authored
  f1d1bf6

• [cd][release] fix race conditions (vllm-project#11407)

  Show description for 72d9c31
  youkaichao

  authored
  72d9c31

• [cd][release] add pypi index for every commit and nightly build (vllm-project#11404)

  Show description for 4a91397
  

  youkaichao

  and

  ywang96

  authored
  4a91397

• [CI] Fix flaky entrypoint tests (vllm-project#11403)

  Show description for 29c7489
  ywang96

  authored
  29c7489

Commits on Dec 21, 2024

• [Bugfix] Fix issues for Pixtral-Large-Instruct-2411 (vllm-project#11393)

  Show description for c2d1b07
  

  ywang96

  and

  ywang96

  authored
  c2d1b07

• [V1] Make AsyncLLMEngine v1-v0 opaque (vllm-project#11383)

  Show description for 584f0ae
  rickyyx

  authored
  584f0ae

• [Bugfix] update should_ignore_layer (vllm-project#11354)

  Show description for 51ff216
  horheynm

  authored
  51ff216

• [V1][Bugfix] Skip hashing empty or None mm_data (vllm-project#11386)

  Show description for dd2b563
  WoosukKwon

  authored
  dd2b563

Commits on Dec 20, 2024

• Add ray[default] to wget to run distributed inference out of box (vllm-project#11265)

  Show description for 47a0b61
  Jeffwan

  authored
  47a0b61

• [doc] explain nccl requirements for rlhf (vllm-project#11381)

  Show description for 5d2248d
  youkaichao

  authored
  5d2248d

• [Bugfix] Don't log OpenAI field aliases as ignored (vllm-project#11378)

  Show description for d573aea
  mgoin

  authored
  d573aea

• [Core] Loading model from S3 using RunAI Model Streamer as optional loader (vllm-project#10192)

  Show description for 995f562
  omer-dayan

  authored
  995f562

• [CI/Build] fix pre-compiled wheel install for exact tag (vllm-project#11373)

  Show description for 7c7aa37
  dtrifiro

  authored
  7c7aa37

• [V1] Fix profiling for models with merged input processor (vllm-project#11370)

  Show description for 04139ad
  ywang96

  authored
  04139ad

• [doc] backward compatibility for 0.6.4 (vllm-project#11359)

  Show description for 1ecc645
  youkaichao

  authored
  1ecc645

• [misc] add early error message for custom ops (vllm-project#11355)

  Show description for c954f21
  youkaichao

  authored
  c954f21

• [Bugfix] Fix spec decoding when seed is none in a batch (vllm-project#10863)

  Show description for 86c2d8f
  wallashss

  authored
  86c2d8f

• [Misc] Add tqdm progress bar during graph capture (vllm-project#11349)

  Show description for b880ffb
  mgoin

  authored
  b880ffb

• [ci][gh200] dockerfile clean up (vllm-project#11351)

  Show description for 7801f56
  

  3 peopleauthored
  7801f56

• [Bugfix][Hardware][POWERPC] Fix auto dtype failure in case of POWER10 (vllm-project#11331)

  Show description for 48edab8
  Akashcodes732

  authored
  48edab8

Commits on Dec 19, 2024

• [CI] Adding CPU docker pipeline (vllm-project#11261)

  Show description for a985f7a
  

  zhouyuan

  and

  khluu

  authored
  a985f7a

• [Misc] Remove unused vllm/block.py (vllm-project#11336)

  Ghjk94522

  authored
  e461c26

• [Bugfix] Fix broken CPU compressed-tensors test (vllm-project#11338)

  Show description for 276738c
  Isotr0py

  authored
  276738c

Pagination

PreviousNext