Code

Added Medusa adapters per request#454

Code

Merged

tgaddair merged 11 commits intomainpredibase/lorax:mainfrom medusa-lora-looppredibase/lorax:medusa-lora-loopCopy head branch name to clipboardMay 2, 2024

+101-14

Commits

Commits on May 1, 2024

• WIP: segmented medusa

  tgaddair

  committed
  8c70688

• Fix naming

  tgaddair

  committed
  a6ff027

• Fix segmented matmul

  tgaddair

  committed
  bec835e

• Better error message

  tgaddair

  committed
  1ddcf02

• Fix DAL

  tgaddair

  committed
  1c934b8

• Fixed type casting

  tgaddair

  committed
  6afc5b7

• Merge branch 'main' into medusa-lora-loop

  tgaddair

  committed
  3e2fef8

• Merge branch 'main' into medusa-lora-loop

  tgaddair

  committed
  d3b879d

• Fixed indices

  tgaddair

  committed
  34fb2f4

Commits on May 2, 2024

• Check speculative tokens

  tgaddair

  committed
  ccc4003

• Update restrictions

  tgaddair

  committed
  f9afe58