Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Model Ability为 Chat 的模型无法使用 Generate API #2586

Open
1 of 3 tasks
alvinlee518 opened this issue Nov 26, 2024 · 0 comments
Open
1 of 3 tasks

Model Ability为 Chat 的模型无法使用 Generate API #2586

alvinlee518 opened this issue Nov 26, 2024 · 0 comments
Labels
gpu
Milestone
v1.x

Comments

@alvinlee518
Copy link

alvinlee518 commented Nov 26, 2024 •
edited
Loading

System Info / 系統信息

release '24.04.1 LTS'

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？

  • docker / docker
  • pip install / 通过 pip install 安装
  • installation from source / 从源码安装

Version info / 版本信息

CPU Info Usage: 0.02Total: 8.00
CPU Memory Info Usage: 2922.32MiBTotal: 29692.38MiB
GPU Info Total: 1.00
GPU Memory Info Usage: 14115.31MiBTotal: 23028.00MiB
Version Release: v0.16.3Commit: 85ab86bf1c0967e45fbec995534cd5a0c9a9c439

The command used to start Xinference / 用以启动 xinference 的命令

通过pip install --upgrade "xinference[all]"执行升级到版本v0.16.3

Reproduction / 复现过程

image
image

Expected behavior / 期待表现

Generate API可以正常使用
@XprobeBot XprobeBot added the gpu label Nov 26, 2024
@XprobeBot XprobeBot added this to the v1.x milestone Nov 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
gpu
Projects
None yet
Milestone
v1.x
Development

No branches or pull requests
2 participants
@alvinlee518 @XprobeBot