[Usage]:Qwen2-VL not support Lora

[menglrskr]

Your current environment

The output of `python collect_env.py`

File "/home/mlr/.local/lib/python3.10/site-packages/vllm/engine/async_llm_engine.py", line 265, in init
super().init(*args, **kwargs)
File "/home/mlr/.local/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 335, in init
self.model_executor = executor_class(
File "/home/mlr/.local/lib/python3.10/site-packages/vllm/executor/executor_base.py", line 47, in init
self._init_executor()
File "/home/mlr/.local/lib/python3.10/site-packages/vllm/executor/gpu_executor.py", line 40, in _init_executor
self.driver_worker.load_model()
File "/home/mlr/.local/lib/python3.10/site-packages/vllm/worker/worker.py", line 183, in load_model
self.model_runner.load_model()
File "/home/mlr/.local/lib/python3.10/site-packages/vllm/worker/model_runner.py", line 1062, in load_model
self.model = get_model(model_config=self.model_config,
File "/home/mlr/.local/lib/python3.10/site-packages/vllm/model_executor/model_loader/init.py", line 19, in get_model
return loader.load_model(model_config=model_config,
File "/home/mlr/.local/lib/python3.10/site-packages/vllm/model_executor/model_loader/loader.py", line 398, in load_model
model = _initialize_model(model_config, self.load_config,
File "/home/mlr/.local/lib/python3.10/site-packages/vllm/model_executor/model_loader/loader.py", line 175, in _initialize_model
return build_model(
File "/home/mlr/.local/lib/python3.10/site-packages/vllm/model_executor/model_loader/loader.py", line 156, in build_model
extra_kwargs = _get_model_initialization_kwargs(model_class, lora_config,
File "/home/mlr/.local/lib/python3.10/site-packages/vllm/model_executor/model_loader/loader.py", line 133, in _get_model_initialization_kwargs
raise ValueError(
ValueError: Model Qwen2VLForConditionalGeneration does not support LoRA, but LoRA is enabled. Support for this model may be added in the future. If this is important to you, please open an issue on github.

How would you like to use vllm

I want to run inference of a [specific model](put link here). I don't know how to integrate it with vllm.

Before submitting a new issue...

• Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

[DarkLight1337]

Please see #10178 (comment)