Code

Pipeline placement with zigzag#25

Code

Merged

shawlleyw merged 8 commits intocuda-graphUSC-NSL/DisagMoE:cuda-graphfrom pipeline-placementUSC-NSL/DisagMoE:pipeline-placementCopy head branch name to clipboardDec 17, 2024

+353-111

Commits

Commits on Dec 13, 2024

• Added pipeline placement; tested placement correctness

  hogura99

  committed
  bafa0ef

• Fix wrong layer_id when using pipeline placement; tested for -o 128 -n 800

  hogura99

  committed
  1700ea1

• fix layer mappings

  shawlleyw

  committed
  7f7ef4e

Commits on Dec 16, 2024

• change base placement api

  shawlleyw

  committed
  96be7d5

• Fixed hard-coding get_exp_rank at AttnDispatcher

  hogura99

  committed
  88a9585

• Merge branch 'pipeline-placement' of github.com:USC-NSL/DisagMoE into pipeline-placement

  hogura99

  committed
  ade086c

• Update num layers

  hogura99

  committed
  8997fcc

• Update parser args

  hogura99

  committed
  2e53dac