Code

[Misc] Upgrade to pytorch 2.5#9588

Code

Merged

youkaichao merged 10 commits intovllm-project:mainvllm-project/vllm:mainfrom neuralmagic:pt25neuralmagic/vllm:pt25Copy head branch name to clipboardOct 27, 2024

+48-25

Commits

Commits on Oct 25, 2024

• upgrade to pytorch 2.5 (still needs newer xformers

  Show description for e970933
  bnellnm

  committed
  e970933

• update xformers

  Show description for 5a54b48
  bnellnm

  committed
  5a54b48

• use better method for specifying cuda libs

  Show description for 1ea632b
  bnellnm

  committed
  1ea632b

• try to make pytorch 2.5 use CUDA 12.1

  Show description for c00efe3
  bnellnm

  committed
  c00efe3

• remove extra index 12.1 for now

  Show description for c4ebdba
  bnellnm

  committed
  c4ebdba

• update flash attn git hash

  Show description for 39f9c34
  bnellnm

  committed
  39f9c34

• downgrade cpu pytorch version

  Show description for f1f3caa
  bnellnm

  committed
  f1f3caa

Commits on Oct 27, 2024

• Merge branch 'main' into pt25

  youkaichao

  committed
  568510a

• fix sdpa cudnn

  Show description for 0068133
  youkaichao

  committed
  0068133

• fix tests

  Show description for 5250a65
  youkaichao

  committed
  5250a65