New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FTL非常高，这属于正常吗？ #54

Open

iwantofun opened this issue Nov 1, 2024 · 1 comment

iwantofun commented Nov 1, 2024

你好，

环境为：

运行例子 models/Qwen2_5
模型文件为：qwen2.5-7b_int4_seq8192_1dev.bmodel
结果 FTL 这么高？正常吗？有什么优化方法吗？

Collaborator

chuxiaoyi2023 commented Nov 12, 2024

很正常的，在上面那个已经回答了~

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment