Adam at the Edge of Stability: Adaptive Feedback, Provable Oscillation, and Gradient Reversal

Yiman Fong, Heng Yang

The edge-of-stability (EoS) phenomenon of full-batch Adam has been widely observed, yet its underlying dynamical mechanism remains poorly understood. In this paper, we identify Ada…