Code

Fp8 dyn per tok#6590

Code

Closed

robertgshaw2-neuralmagic wants to merge 14 commits intovllm-project:mainvllm-project/vllm:mainfrom neuralmagic:fp8-dyn-per-tokneuralmagic/nm-vllm:fp8-dyn-per-tokCopy head branch name to clipboard

+68-39

Commits

Commits on Jul 18, 2024

• stash

  robertgshaw2-neuralmagic

  committed
  2426e29

• format

  robertgshaw2-neuralmagic

  committed
  7665b7b

• tweak arg name

  robertgshaw2-neuralmagic

  committed
  ef27613

• fix test

  robertgshaw2-neuralmagic

  committed
  2f96157

• format

  robertgshaw2-neuralmagic

  committed
  e748554

Commits on Jul 19, 2024

• Merge branch 'main' into turn-on-fp8-dyn-per-token

  robertgshaw2-neuralmagic

  committed
  15cc823

• stash

  robertgshaw2-neuralmagic

  committed
  d064dd7

• dynamic per token

  robertgshaw2-neuralmagic

  committed
  6aa37e5

• format

  robertgshaw2-neuralmagic

  committed
  c9d819a

• reenable cutlass

  robertgshaw2-neuralmagic

  committed
  08cbaf7

• cleanup comment

  robertgshaw2-neuralmagic

  committed
  f4cdda1

• format

  robertgshaw2-neuralmagic

  committed
  2971f4d

• added dynamic per token test case

  robertgshaw2-neuralmagic

  committed
  b601033

• Merge branch 'main' into turn-on-fp8-dyn-per-token

  robertgshaw2-neuralmagic

  committed
  58992e7