Popular repositories Loading

1. HeavyBall HeavyBall Public

   Efficient optimizers

   Python 276 25

2. revlib revlib Public

   Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload

   Python 131 6

3. HomebrewNLP-torch HomebrewNLP-torch Public

   A case study of efficient training of large language models using commodity hardware.

   Python 68 8

4. Olmax Olmax Public

   HomebrewNLP in JAX flavour for maintable TPU-Training

   Python 51 6

5. TrueGrad TrueGrad Public

   PyTorch interface for TrueGrad Optimizers

   Python 43 1

6. LightBench LightBench Public

   lightweight optimizer benchmark

   Python 5