Releases · Lightning-AI/litgpt

What's Changed

Streaming for serving with chat's generate function by @rasbt in #1426
Add MicroLlama training support by @keeeeenw in #1457
Check checkpoint_dir and add checkpoints to path by @rasbt in #1454
Detect tensor cores by @rasbt in #1456
Explain how to list all available models by @rasbt in #1455
Update error message by @rasbt in #1453
New CLI by @rasbt in #1437
A more centered look by @rasbt in #1449
Update README.md for one last time by @rasbt in #1442
Fix README.md alignment by @rasbt in #1439
Pin litdata by @rasbt in #1440
Align readme by @rasbt in #1438
Fix learning rate calculation in pretrain by @rasbt in #1435
Fix optimizer init with fused=True by @carmocca in #1434
OptimizerArgs by @rasbt in #1409
Simplify code by @rasbt in #1429
Add prompt style mapping for llama3 by @davmacario in #1406
Fix bug where LitData doesn't use seed by @bradfordlynch in #1425
Minimal Python example by @rasbt in #1410
Support no_sync with Thunder FSDP by @carmocca in #1414
Explain dataset options by @rasbt in #1407
Allow multiline prompts by @rasbt in #1279
LitData: set iterate_over_all to False for CombinedStreamingDataset by @Andrei-Aksionov in #1404
Simillar -> Similar by @rasbt in #1405
Remove per-file CLIs by @carmocca in #1397
Set litdata < 0.2.6 by @carmocca in #1400