We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
评测方法中需要输入/path/to/tokenizer/tokenizer.model ,但是Qwen-7B不会生成tokenizer.model ,请问我该如何进行评测呢?
python profile_restful_api.py http://0.0.0.0:33337 /data/cgq/workspace/triton_models/tokenizer/tokenizer.model /home/gqchen/ShareGPT_V3_unfiltered_cleaned_split.json --concurrency 5
No response
The text was updated successfully, but these errors were encountered:
忘记qwen是tikoken了。 感觉我们得改下restful_api的profile方式。我们内部先讨论下,有结论后再来同步
Sorry, something went wrong.
Hi, @cgq0816 the bug was fixed in #443
AllentDan
No branches or pull requests
Checklist
Describe the bug
评测方法中需要输入/path/to/tokenizer/tokenizer.model ,但是Qwen-7B不会生成tokenizer.model ,请问我该如何进行评测呢?
Reproduction
python profile_restful_api.py http://0.0.0.0:33337 /data/cgq/workspace/triton_models/tokenizer/tokenizer.model /home/gqchen/ShareGPT_V3_unfiltered_cleaned_split.json --concurrency 5
Error traceback
No response
The text was updated successfully, but these errors were encountered: