How much faster is deepspeed + pytorch 2.x compared to 1.x? #4621
zhoumengbo
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
We know that upgrading PyTorch from 1.x to 2.x has significantly improved speed. So for DeepSpeed, after becoming compatible with PyTorch 2.x, has there been a significant improvement in the speed of parallel training, and are there any actual cases and data for analysis?
Beta Was this translation helpful? Give feedback.
All reactions