Skip to content

Leaderworkerset v0.3.0
Compare
Choose a tag to compare
@liurupeng liurupeng released this 04 Jun 20:42
v0.3.0
This tag was signed with the committer’s verified signature.
liurupeng RupengLiu
GPG key ID: F7B6C57BBF1B9C6D
Learn about vigilant mode.
f55ce01
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

Features:

  • RollingUpdate with MaxSurge support
  • Subgroup support for disaggregated serving
  • Example for multi-node serving of llama 70B on GPUs with vLLM
  • Add a new start policy API
  • Inject leader address environment variable to every container
  • Spec.rolloutStrategy should be a non-required field

Acknowledgments

Thanks to our contributors in this release, in alphabetic order:
@ahg-g @Edwinhr716 @googs1025 @gujingit @jjk-g @kerthcet @liurupeng @nayihz

Contributors

liurupeng, gujingit, and 6 other contributors
Assets 3
Loading