Visualization Rastrigin AccSGD AdaBelief AdaBound AdaDelta AdaFactor AdaHessian Adai Adalite Adam AdaMax AdamG AdaMod AdamP AdamS AdamW Adan AdaNorm AdaPNM AdaShift AdaSmooth AdaTAM AdEMAMix ADOPT AggMo Aida Amos APOLLO ApolloDQN ASGD AvaGrad CAME DAdaptAdaGrad DAdaptAdam DAdaptAdan DAdaptLion DAdaptSGD DiffGrad FAdam Fromage FTRL GaLore Grams Gravity GrokFastAdamW Kate Lamb LaProp LARS Lion MADGRAD MARS MSVAG Muon Nero NovoGrad PAdam PID PNM Prodigy QHAdam QHM RAdam Ranger Ranger21 Ranger25 ScalableShampoo ScheduleFreeAdamW ScheduleFreeRAdam ScheduleFreeSGD SGD SGDP SGDSaI SGDW Shampoo SignSGD SM3 SOAP SophiaH SPAM SRMM StableAdamW SWATS TAM Tiger Yogi Rosenbrock AccSGD AdaBelief AdaBound AdaDelta AdaFactor AdaHessian Adai Adalite Adam AdaMax AdamG AdaMod AdamP AdamS AdamW Adan AdaNorm AdaPNM AdaShift AdaSmooth AdaTAM AdEMAMix ADOPT AggMo Aida Amos APOLLO ApolloDQN ASGD AvaGrad CAME DAdaptAdaGrad DAdaptAdam DAdaptAdan DAdaptLion DAdaptSGD DiffGrad FAdam Fromage FTRL GaLore Grams Gravity GrokFastAdamW Kate Lamb LaProp LARS Lion MADGRAD MARS MSVAG Muon Nero NovoGrad PAdam PID PNM Prodigy QHAdam QHM RAdam Ranger Ranger21 Ranger25 ScalableShampoo ScheduleFreeAdamW ScheduleFreeRAdam ScheduleFreeSGD SGD SGDP SGDSaI SGDW Shampoo SignSGD SM3 SOAP SophiaH SPAM SRMM StableAdamW SWATS TAM Tiger Yogi
