missing ray modules

[Jmkernes]

ray.serve.experimental has no directory for llm https://github.com/ray-project/ray/tree/master/python/ray/serve/experimental
and I've also grep'ed the entire repo for any mention of the imported classes in launch_scripts/launch_ray_dynamic_gen

Where is this code coming from?

[evinism]

+1 to this, there a feature branch this is operating on?

[cadedaniel]

Thanks for creating an issue! We have the code in this repo (v0.2.0) https://github.com/ray-project/ray-llm. I think since vLLM provides much better performance we will deprecate the code in a new version.