Code

custom allreduce + torch.compile#10121

Code

Merged

youkaichao merged 15 commits intovllm-project:mainvllm-project/vllm:mainfrom neuralmagic:custom-ar-stuffneuralmagic/vllm:custom-ar-stuffCopy head branch name to clipboardNov 26, 2024

+59-101

Commits

Commits on Nov 7, 2024

• init

  SageMoore

  committed
  7bed9ba

Commits on Nov 8, 2024

• use context manager when running with pynccl

  SageMoore

  committed
  fa683d4

• only run custom ar when should_custom_ar is true

  SageMoore

  committed
  8576610

• Merge branch 'main' of https://github.com/neuralmagic/vllm into custom-ar-stuff

  SageMoore

  committed
  13069d0

Commits on Nov 12, 2024

• temporarily disable custom ar

  SageMoore

  committed
  564cdad

Commits on Nov 25, 2024

• Merge branch 'main' into custom-ar-stuff

  youkaichao

  committed
  3109c1a

Commits on Nov 26, 2024

• update

  Show description for a86bb7c
  youkaichao

  committed
  a86bb7c

• improving

  Show description for 35d0e17
  youkaichao

  committed
  35d0e17

• enable pynccl by default

  Show description for 3e9d218
  youkaichao

  committed
  3e9d218

• draft

  Show description for 54c7fb1
  youkaichao

  committed
  54c7fb1

• simplify

  Show description for 145ad3b
  youkaichao

  committed
  145ad3b

• simplify

  Show description for 100d26c
  youkaichao

  committed
  100d26c

• add fallback

  Show description for a2dceca
  youkaichao

  committed
  a2dceca

• fix tests (update for out-of-place allreduce)

  Show description for c50abd2
  youkaichao

  committed
  c50abd2

• fix tests

  Show description for 53e0099
  youkaichao

  committed
  53e0099