2 papers
cs.LG2026
Provable Edge-of-Stability for Adam on a One-Dimensional Quadratic
Yiman Fong, Heng Yang
The edge-of-stability (EoS) phenomenon of Adam has been widely observed, while its underlying dynamical mechanism is not yet fully understood. We study uncorrected Adam on a one-di…
cs.LG2025
Accelerating Optimization via Differentiable Stopping Time
Zhonglin Xie, Yiman Fong, Haoran Yuan +1
Optimization is an important module of modern machine learning applications. Tremendous efforts have been made to accelerate optimization algorithms. A common formulation is achiev…