v0.0.6.5

hrfng released this 26 Mar 06:22

· 8 commits to main since this release

support openai chat protocol
support dynamic batch
support jina embedding
support qwen1.5 hf
support vllm 0.3.3

Assets 2