Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

模型无法选择gpu,只有cpu选项 #2578

Open
1 of 3 tasks
wz96cj opened this issue Nov 24, 2024 · 2 comments
Open
1 of 3 tasks

模型无法选择gpu,只有cpu选项 #2578

wz96cj opened this issue Nov 24, 2024 · 2 comments
Labels
Milestone

Comments

@wz96cj
Copy link

wz96cj commented Nov 24, 2024

System Info / 系統信息

cuda:12.4
操作系统:win--wsl2

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece?

  • docker / docker
  • pip install / 通过 pip install 安装
  • installation from source / 从源码安装

Version info / 版本信息

xinference:0.16.3

The command used to start Xinference / 用以启动 xinference 的命令

XINFERENCE_HOME=/home/xxx/xinference/ xinference-local --host 0.0.0.0 --port 9997 --log-level debug

Reproduction / 复现过程

image
image
image

Expected behavior / 期待表现

可以选择gpu

@XprobeBot XprobeBot added the gpu label Nov 24, 2024
@XprobeBot XprobeBot added this to the v0.16 milestone Nov 24, 2024
@qinxuye
Copy link
Contributor

qinxuye commented Nov 25, 2024

python -c "import torch; print(torch.cuda.is_available())"

跑下看下。

@XprobeBot XprobeBot modified the milestones: v0.16, v1.x Nov 25, 2024
@wz96cj
Copy link
Author

wz96cj commented Nov 26, 2024

python -c "import torch; print(torch.cuda.is_available())"

跑下看下。

输出也是true 不知道是win10--wsl的原因 在win11的wsl上跑了一套是正常的

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants