nm-vllm 0.5.1.1
Key Features
The nm-vllm 0.5.1.1 release is based on upstream vllm = v0.5.1
What's Changed
- The nm-vllm docker image name is changed from nm-vllm-openai to nm-vllm-ent. The new docker package is published here: https://github.com/neuralmagic/nm-vllm-certs/pkgs/container/nm-vllm-ent