Updated inline vllm inference provider#880

Open

frreiss wants to merge 9 commits intometa-llama:mainfrom frreiss:vllm2

+860-175

Commits on Jan 23, 2025

Import updated vLLM code and get tests working
frreiss
committed

Commits on Jan 24, 2025

Commits on Jan 26, 2025