Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: ValueError: Model Qwen2VLForConditionalGeneration does not support LoRA, but LoRA is enabled. Support for this model may be added in the future. If this is important to you, please open an issue on github. #10178

Closed
1 task done
cv-nlp opened this issue Nov 9, 2024 · 3 comments

Comments

@cv-nlp
Copy link

cv-nlp commented Nov 9, 2024

Your current environment

Will Qwen2-VL support LoRA reasoning in the future? I want to try multiple LoRA reasoning experiments.

Model Input Dumps

No response

🐛 Describe the bug

Will Qwen2-VL support LoRA reasoning in the future? I want to try multiple LoRA reasoning experiments.

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
@cv-nlp cv-nlp added the bug Something isn't working label Nov 9, 2024
@DarkLight1337
Copy link
Member

DarkLight1337 commented Nov 9, 2024

LoRA support for the language backbone of Qwen2-VL has already been added in #10022. It will be in the next release (or you can build vLLM from source to use it now).

@cv-nlp
Copy link
Author

cv-nlp commented Nov 9, 2024

LoRA support for the language backbone of Qwen2-VL has already been added in #10022. It will be in the next release (or you can build vLLM from source to use it now).

Thanks bro,I'll try it

@DarkLight1337 DarkLight1337 added feature request and removed bug Something isn't working labels Nov 9, 2024
@DarkLight1337 DarkLight1337 changed the title [Bug]: ValueError: Model Qwen2VLForConditionalGeneration does not support LoRA, but LoRA is enabled. Support for this model may be added in the future. If this is important to you, please open an issue on github. [Feature]: ValueError: Model Qwen2VLForConditionalGeneration does not support LoRA, but LoRA is enabled. Support for this model may be added in the future. If this is important to you, please open an issue on github. Nov 9, 2024
@DarkLight1337
Copy link
Member

Feel free to re-open if your issue persists!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants