Adam-SHANG: A Convergent Adam-Type Method for Stochastic Smooth Convex Optimization

Yaxin Yu, Long Chen, Minfu Feng

We propose Adam-SHANG, a Lyapunov-guided Adam-type method that couples momentum, adaptive preconditioning, and a curvature-aware correction through a more stable lagged-preconditio…