[New feature] Add inference load balance controller for fastdeploy llm#2276
Open
rainyfly wants to merge 9 commits intoPaddlePaddle:llmfrom rainyfly:add_fastdeploy_ic
+992
Commits
Commits on Nov 8, 2023
Commits on Nov 20, 2023
- committed
Commits on Nov 21, 2023
- committed