Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Usage]: 推理报错 #4

Open
bravelll opened this issue Jul 21, 2024 · 1 comment
Open

[Usage]: 推理报错 #4

bravelll opened this issue Jul 21, 2024 · 1 comment

Comments

@bravelll
Copy link

Your current environment

The output of `python collect_env.py`

How would you like to use vllm

I want to run inference of a [specific model](put link here). I don't know how to integrate it with vllm.

OSError: /u01/xxx
/.cache/modelscope/hub/OpenBMB/MiniCPM-Llama3-V-2_5 does not appear to have a file named preprocessor_config.json. Checkout

@HwwwwwwwH
Copy link
Collaborator

Please check the update of OpenBMB/MiniCPM-Llama3-V-2_5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants