Update README

kaustpradalab · Aug 5, 2024 · 3eea0c8 · 3eea0c8
1 parent fa16e7d
commit 3eea0c8
Showing 1 changed file with 4 additions and 1 deletion.
diff --git a/README.md b/README.md
@@ -47,6 +47,9 @@ torchrun --nproc_per_node num_device --nnodes 1 example/ddp/train.py
 
 # Zero1 mode
 torchrun --nproc_per_node num_device --nnodes 1 example/zero1/train.py
+
+# Zero2 mode
+torchrun --nproc_per_node num_device --nnodes 1 example/zero2/train.py
 ```
 
 This will initiate a simple training loop using the Tiny-DeepSpeed framework.
@@ -56,7 +59,7 @@ This will initiate a simple training loop using the Tiny-DeepSpeed framework.
 - [X] Single Device
 - [X] DDP
 - [X] Zero1
-- [ ] Zero2
+- [X] Zero2
 - [ ] Zero3
 - [ ] AMP support
 - [X] Compute-communication overlap