Skip to content

Releases: lightonai/vllm

v0.5.3.post1

25 Jul 16:47
Compare
Choose a tag to compare

v0.5.1

12 Jul 14:10
Compare
Choose a tag to compare

v0.5.0.post1

04 Jul 09:27
Compare
Choose a tag to compare

v0.4-custom.2.dev.5

26 Apr 15:55
Compare
Choose a tag to compare
v0.4-custom.2.dev.5 Pre-release
Pre-release
Add max_num_seqs to deployment script

v0.4-custom.2.dev.2

25 Apr 14:42
Compare
Choose a tag to compare

v0.4-custom.2.dev.1

23 Apr 20:19
Compare
Choose a tag to compare

v0.4-custom.1

19 Apr 08:58
Compare
Choose a tag to compare
  • Falcon/Alfred LoRA support
  • Read LoRAs params from env vars
  • Add SageMaker support for LoRAs
  • Add the /loras endpoint to add LoRAs while the server is running

v0.4-canary.3

18 Apr 11:29
Compare
Choose a tag to compare
v0.4-canary.3 Pre-release
Pre-release
  • Read LoRAs params from env vars

v0.4-canary.2

12 Apr 12:01
Compare
Choose a tag to compare
v0.4-canary.2 Pre-release
Pre-release
  • Add SageMaker support for LoRAs
  • Add the /loras endpoint to add LoRAs while the server is running

v0.4.0

05 Apr 14:33
Compare
Choose a tag to compare