Code

optimize fill kv cache#523

Code

Merged

lvhan028 merged 8 commits intoInternLM:pytorch-pocInternLM/lmdeploy:pytorch-pocfrom grimoire:optimize-fill-cachegrimoire/lmdeploy:optimize-fill-cacheCopy head branch name to clipboardOct 9, 2023

+230-103

Commits

Commits on Oct 7, 2023

• optimize fill kv cache

  grimoire

  committed
  8dde898

• update internlm

  grimoire

  committed
  6edc78c

• faster embedding

  grimoire

  committed
  996ac70

Commits on Oct 8, 2023

• fix bias tp

  grimoire

  committed
  3271d31

• fix baichuan2

  grimoire

  committed
  c27aa34

• fix fill kv cache

  grimoire

  committed
  46e71d4

Commits on Oct 9, 2023

• solve conflict

  grimoire

  committed
  48ea6e0

• fix lint

  grimoire

  committed
  dcc4719