Skip to content

v0.0.20: Multi-node training, SD Lora, sentence transformers clip, TGI improvements

Compare
Choose a tag to compare
@dacorvo dacorvo released this 07 Mar 10:14

What's Changed

Training

TGI

  • optimize continuous batching and improve export (#506)

Inference

Doc

Bug fixes

  • inference cache: omit irrelevant config parameters in lookup dy @dacorvo (#494)
  • Optimize disk usage when fetching model checkpoints by @dacorvo (#505)

Full Changelog: v0.0.19...v0.0.20