From fbb3af25a85156128c0e12d9f6c022b775b909c3 Mon Sep 17 00:00:00 2001 From: Xinyi Wan Date: Mon, 20 Nov 2023 14:19:42 +0800 Subject: [PATCH] Fix images in readme --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index dea23e3bf3..9929ce0c0e 100644 --- a/README.md +++ b/README.md @@ -25,6 +25,7 @@ Experiments shows zero bubble pipeline parallelism can accelerate training up to ## Zero Bubble Schedules The key of achieving zero bubble is to breaking a backward pass into a $B$ pass and $W$ pass. $B$ on one stage will only depend on the $B$ on its next stage, compared to depending on both $B$ and $W$ of in 1F1B. + ![image](https://hackmd.io/_uploads/Bkc7CL7N6.png) ### Comparision of Schedules