Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[Bugfix] No num_gpus for ROCm and XPU when connecting to a ray cluster
I don't find any reason for making a special case for ROCm and XPU, as they should make no difference with CUDA or something else in this case. Error log: File "vllm/vllm/engine/llm_engine.py", line 528, in _get_executor_cls initialize_ray_cluster(engine_config.parallel_config) File "vllm/vllm/executor/ray_utils.py", line 230, in initialize_ray_cluster ray.init(address=ray_address, File "venv/lib/python3.11/site-packages/ray/_private/client_mode_hook.py", line 103, in wrapper return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "venv/lib/python3.11/site-packages/ray/_private/worker.py", line 1689, in init raise ValueError( ValueError: When connecting to an existing cluster, num_cpus and num_gpus must not be provided. Signed-off-by: Hollow Man <[email protected]>
- Loading branch information