Code

Add DeepSeek-V2 support#2763

Code

Merged

lvhan028 merged 24 commits intoInternLM:mainInternLM/lmdeploy:mainfrom lzhangzz:simple-mlalzhangzz/lmdeploy:simple-mlaCopy head branch name to clipboardNov 29, 2024

+2,118-861

Commits

Commits on Nov 7, 2024

• add qwen2-moe

  lzhangzz

  committed
  e0b221e

  Copy full SHA for e0b221e

• eliminate inter_size_ from ffn layer

  lzhangzz

  committed
  cea0524

  Copy full SHA for cea0524

• clean up

  lzhangzz

  committed
  b7d050a

  Copy full SHA for b7d050a

• fix lint

  lzhangzz

  committed
  8fade57

  Copy full SHA for 8fade57

• clean up

  lzhangzz

  committed
  4c0f902

  Copy full SHA for 4c0f902

Commits on Nov 8, 2024

• layer-wise inter_size & expert_num

  lzhangzz

  committed
  da6aeff

  Copy full SHA for da6aeff

• Merge remote-tracking branch 'origin/main' into simple-mla

  lzhangzz

  committed
  ef9a5f2

  Copy full SHA for ef9a5f2

Commits on Nov 11, 2024

• add head dim 192

  lzhangzz

  committed
  1ecf291

  Copy full SHA for 1ecf291

Commits on Nov 13, 2024

• refactor weight processing

  lzhangzz

  committed
  0caa113

  Copy full SHA for 0caa113

Commits on Nov 17, 2024

• deepseek-v2-lite

  lzhangzz

  committed
  260c9f0

  Copy full SHA for 260c9f0

Commits on Nov 19, 2024

• deepseek-v2

  lzhangzz

  committed
  375afb4

  Copy full SHA for 375afb4

Commits on Nov 20, 2024

• Merge remote-tracking branch 'origin/main' into simple-mla

  lzhangzz

  committed
  b8abe54

  Copy full SHA for b8abe54

• fix lint

  lzhangzz

  committed
  bc296e5

  Copy full SHA for bc296e5

• fix lint

  lzhangzz

  committed
  8fb10ba

  Copy full SHA for 8fb10ba

• fix ut

  lzhangzz

  committed
  103ba46

  Copy full SHA for 103ba46

Commits on Nov 25, 2024

• Update config.yaml

  zhulinJulia24

  authored
  9c7dbbd

  Copy full SHA for 9c7dbbd

• Update config.yaml

  zhulinJulia24

  authored
  8169e97

  Copy full SHA for 8169e97

Commits on Nov 26, 2024

• fix mixtral

  lzhangzz

  committed
  4d71007

  Copy full SHA for 4d71007

• Merge branch 'simple-mla' of github.com:lzhangzz/lmdeploy into simple-mla

  lzhangzz

  committed
  9b1a82b

  Copy full SHA for 9b1a82b

Commits on Nov 27, 2024

• fix moe gating & config parsing

  lzhangzz

  committed
  c6bd5fe

  Copy full SHA for c6bd5fe

• fix yarn for deepseek-v2

  lzhangzz

  committed
  3d4f22f

  Copy full SHA for 3d4f22f

• fix copy_from

  lzhangzz

  committed
  329e441

  Copy full SHA for 329e441

Commits on Nov 28, 2024

• fix rms norm, rotary embedding & deepseek v2 attention

  lzhangzz

  committed
  90d2529

  Copy full SHA for 90d2529

• remove debug code

  lzhangzz

  committed
  f565ef7

  Copy full SHA for f565ef7