Adam under Generalized Smoothness with Second-Moment-Type Stochastic Gradients

Ruinan Jin, Difei Cheng, Ling Chen +3

Adam is widely observed to remain stable even when the objective deviates significantly from global smoothness. Under the generalized smoothness framework, however, existing analys…