Does deepspeed have chunk based memory mangement? #3459
Unanswered
skyshine102
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
As title, I'm curious about if any chunk-based memory management strategy exists in deepspeed?
I found a paper from Tencent ->
https://github.com/Tencent/PatrickStar
How does current deepspeed memory management system compared this one?
Need some pointers!
Beta Was this translation helpful? Give feedback.
All reactions