Skip to content

Commit

Permalink
Fix images in readme
Browse files Browse the repository at this point in the history
  • Loading branch information
Xinyi Wan committed Nov 20, 2023
1 parent 7c89dd4 commit fbb3af2
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,6 +25,7 @@ Experiments shows zero bubble pipeline parallelism can accelerate training up to

## Zero Bubble Schedules
The key of achieving zero bubble is to breaking a backward pass into a $B$ pass and $W$ pass. $B$ on one stage will only depend on the $B$ on its next stage, compared to depending on both $B$ and $W$ of in 1F1B.

![image](https://hackmd.io/_uploads/Bkc7CL7N6.png)

### Comparision of Schedules
Expand Down

0 comments on commit fbb3af2

Please sign in to comment.