Skip to content

Commit

Permalink
[CPUAdam] Update full_precision_optimizer_states in docstring (#5181)
Browse files Browse the repository at this point in the history
It appears this variable was renamed to `fp32_optimizer_states` so
reflecting this change in docstrings.

Co-authored-by: Olatunji Ruwase <[email protected]>
  • Loading branch information
rohan-varma and tjruwase authored Feb 26, 2024
1 parent 4874941 commit 8c42a30
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion deepspeed/ops/adam/cpu_adam.py
Original file line number Diff line number Diff line change
Expand Up @@ -63,7 +63,7 @@ def __init__(self,
algorithm from the paper `On the Convergence of Adam and Beyond`_
(default: False) NOT SUPPORTED in DeepSpeed CPUAdam!
adamw_mode: select between Adam and AdamW implementations (default: AdamW)
full_precision_optimizer_states: creates momentum and variance in full precision regardless of
fp32_optimizer_states: creates momentum and variance in full precision regardless of
the precision of the parameters (default: True)
"""

Expand Down

0 comments on commit 8c42a30

Please sign in to comment.