Code

Support loading hf model directly#685

Code

Merged

lvhan028 merged 33 commits intoInternLM:mainInternLM/lmdeploy:mainfrom irexyc:from_pretrainedirexyc/lmdeploy:from_pretrainedCopy head branch name to clipboardNov 22, 2023

+1,196-232

Commits

Commits on Nov 14, 2023

• turbomind support export model params

  irexyc

  committed
  0f7a35b

• fix overflow

  irexyc

  committed
  542882a

• support turbomind.from_pretrained

  irexyc

  committed
  9f30d4f

• fix tp

  irexyc

  committed
  8605521

• support AutoModel

  irexyc

  committed
  a050907

• support load kv qparams

  irexyc

  committed
  a3f5fc5

• update auto_awq

  irexyc

  committed
  4426c0a

• udpate docstring

  irexyc

  committed
  f24c905

• export lmdeploy version

  irexyc

  committed
  371320a

• update doc

  irexyc

  committed
  fe81ce9

Commits on Nov 15, 2023

• remove download_hf_repo

  irexyc

  committed
  1c4db1e

• LmdeployForCausalLM -> LmdeployForCausalLM

  irexyc

  committed
  85f0ed0

• refactor turbomind.py

  irexyc

  committed
  5619b44

• update comment

  irexyc

  committed
  00b21d4

• Merge remote-tracking branch 'origin/main' into from_pretrained2

  irexyc

  committed
  d868694

• add bfloat16 convert back

  irexyc

  committed
  a827412

• support gradio run_locl load hf

  irexyc

  committed
  197133d

• support resuful api server load hf

  irexyc

  committed
  47fd6a8

• add docs

  irexyc

  committed
  8dd4876

• support loading previous quantized model

  irexyc

  committed
  ae67e87

• adapt pr 690

  irexyc

  committed
  db51a06

Commits on Nov 16, 2023

• udpate docs

  irexyc

  committed
  68962ce

• resolve conflict in auto_awq.py

  irexyc

  committed
  c6176f3

Commits on Nov 17, 2023

• not export turbomind config when quantize a model

  irexyc

  committed
  4c4ae26

• check model_name when can not get it from config.json

  irexyc

  committed
  2562724

• update readme

  irexyc

  committed
  f41dce4

Commits on Nov 20, 2023

• remove model_name in auto_awq

  irexyc

  committed
  7fa302c

• Merge remote-tracking branch 'origin/main' into from_pretrained

  irexyc

  committed
  4db0e25

Commits on Nov 21, 2023

• update

  irexyc

  committed
  4e82cdf

• update

  irexyc

  committed
  0f9c6f0

Commits on Nov 22, 2023

• udpate

  irexyc

  committed
  b470f06

• fix build

  irexyc

  committed
  d3c5d01

• absolute import

  irexyc

  committed
  6ce951f