New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Qwen2/2.5 with MLX engine miss Chinese character in each line. #2591

Open

1 of 3 tasks

wanfade opened this issue Nov 27, 2024 · 1 comment

Open

1 of 3 tasks

Qwen2/2.5 with MLX engine miss Chinese character in each line. #2591

wanfade opened this issue Nov 27, 2024 · 1 comment

Milestone

wanfade commented Nov 27, 2024

System Info / 系統信息

python3.10, macos, installed with MLX engine.

Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？

docker / docker
pip install / 通过 pip install 安装
installation from source / 从源码安装

Version info / 版本信息

0.16.3

The command used to start Xinference / 用以启动 xinference 的命令

XINFERENCE_MODEL_SRC=modelscope xinference-local --host 0.0.0.0 --port 9997

Reproduction / 复现过程

Install qwen2-instruct by xinference GUI, and test in gradio:

Expected behavior / 期待表现

Complete answer

XprobeBot added this to the v1.x milestone

Contributor

qinxuye commented Nov 27, 2024

I can reproduce, I will dive into to see what's going on.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment