Code

Fetch from hub#1160

Code

Open

mikeshi80 wants to merge 25 commits intoxorbitsai:mainxorbitsai/inference:mainfrom mikeshi80:fetch_from_hubmikeshi80/xinference:fetch_from_hubCopy head branch name to clipboard

+2,506-653

Commits

Commits on Mar 13, 2024

• Split the language model register tab panel into the separated js file.

  mikeshi80

  committed
  b7ea34c

  Copy full SHA for b7ea34c

Commits on Mar 15, 2024

• WIP: 从HUB中获得模型信息

  mikeshi80

  committed
  18f464e

  Copy full SHA for 18f464e

• Merge branch 'main' into fetch_from_hub

  mikeshi80

  committed
  25f2b38

  Copy full SHA for 25f2b38

• add more unit tests for getting model info.

  mikeshi80

  committed
  cc903e1

  Copy full SHA for cc903e1

Commits on Mar 17, 2024

• fix the get model info correctly.

  mikeshi80

  committed
  c108eb0

  Copy full SHA for c108eb0

• fix the wrong llm family build logic.

  mikeshi80

  committed
  c24a459

  Copy full SHA for c24a459

Commits on Mar 18, 2024

• Merge branch 'main' into fetch_from_hub

  mikeshi80

  committed
  3e4f765

  Copy full SHA for 3e4f765

• fix the bug that cannot process quantization with lower case.

  mikeshi80

  committed
  4433f85

  Copy full SHA for 4433f85

• add support for GGUF, GGML of ModelScope

  mikeshi80

  committed
  53ca758

  Copy full SHA for 53ca758

• add async runner to run function async, and add model hub utility to get model hub infos.

  mikeshi80

  committed
  5dc38a1

  Copy full SHA for 5dc38a1

• Did the code refactoring to get gguf and ggml model info.

  mikeshi80

  committed
  3991ae6

  Copy full SHA for 3991ae6

• when model size is decimals, replace dot with underscore.

  mikeshi80

  committed
  c0936e8

  Copy full SHA for c0936e8

• when model size is unknown, not return "UNKNOWN", but 0

  mikeshi80

  committed
  5081c48

  Copy full SHA for 5081c48

• add support of pytorch and awq format to fetch model info from hub.

  mikeshi80

  committed
  f0bd9af

  Copy full SHA for f0bd9af

• add support of pytorch and awq format to fetch model info from hub.

  mikeshi80

  committed
  46e1626

  Copy full SHA for 46e1626

• add the rest api for fetch model info from model hub

  mikeshi80

  committed
  97dbae6

  Copy full SHA for 97dbae6

• Merge branch 'main' into fetch_from_hub

  mikeshi80

  committed
  f915155

  Copy full SHA for f915155

Commits on Mar 19, 2024

• refactor the pytest case with pytest.raises to catch exception.

  mikeshi80

  committed
  b853970

  Copy full SHA for b853970

• fix the but that '0.x' form model id cannot be processed correctly

  mikeshi80

  committed
  b354cec

  Copy full SHA for b354cec

• update caniuse-lite

  mikeshi80

  committed
  e5ba02d

  Copy full SHA for e5ba02d

• Finish LLM custom model register from hub.

  mikeshi80

  committed
  9b774fe

  Copy full SHA for 9b774fe

Commits on Apr 2, 2024

• Merge branch 'main' into fetch_from_hub

  mikeshi80

  committed
  8ed9ece

  Copy full SHA for 8ed9ece

• Finish embedding custom model register from hub.

  mikeshi80

  committed
  c0a636c

  Copy full SHA for c0a636c

• Finish rerank custom model register from hub.

  mikeshi80

  committed
  be6e780

  Copy full SHA for be6e780

Commits on Apr 3, 2024

• fix the bug that Future with generic type will cause error when it is run on python < 3.9

  mikeshi80

  committed
  dc8eb98

  Copy full SHA for dc8eb98