Code

Adding SHM broadcast to ROCm/vllm#113

Code

Closed

Lzy17 wants to merge 12 commits intomainROCm/vllm:mainfrom Lzy17/shm_broadcastROCm/vllm:Lzy17/shm_broadcastCopy head branch name to clipboard

+478-438

Commits

Commits on Jul 25, 2024

• Adding the SHM broadcast

  

  root

  committed
  d56309c

  Copy full SHA for d56309c

Commits on Jul 26, 2024

• Performance Boost

  

  root

  committed
  e139874

  Copy full SHA for e139874

• fix memory leak

  

  root

  committed
  617fa41

  Copy full SHA for 617fa41

Commits on Jul 31, 2024

• Fix acc and memory leak

  

  root

  committed
  ff40e5d

  Copy full SHA for ff40e5d

• remove extra helper functions

  

  root

  committed
  312fa3b

  Copy full SHA for 312fa3b

• remove extra benchmarks

  

  root

  committed
  43d043b

  Copy full SHA for 43d043b

• remove extra comments

  

  root

  committed
  6037ed3

  Copy full SHA for 6037ed3

• resolved conflicts

  

  root

  committed
  50a3c74

  Copy full SHA for 50a3c74

• Merge branch 'main' into Lzy17/shm_broadcast

  Lzy17

  authored
  7151610

  Copy full SHA for 7151610

• fix lint

  

  root

  committed
  028eb85

  Copy full SHA for 028eb85

• fix ruff

  

  root

  committed
  2ad5cf7

  Copy full SHA for 2ad5cf7

• fix ruff

  

  root

  committed
  989203e

  Copy full SHA for 989203e