Showing math.OCShow all
3 papers · 1 filter
math.OC2026
Adam-SHANG: A Convergent Adam-Type Method for Stochastic Smooth Convex Optimization
Yaxin Yu, Long Chen, Minfu Feng
We propose Adam-SHANG, a Lyapunov-guided Adam-type method that couples momentum, adaptive preconditioning, and a curvature-aware correction through a more stable lagged-preconditio…
math.OC2025
Accelerated Gradient Methods Through Variable and Operator Splitting
Long Chen, Luo Hao, Jingrong Wei
This paper introduces a unified framework for accelerated gradient methods through the variable and operator splitting (VOS). The operator splitting decouples the optimization proc…
math.OC2025
Accelerated Over-Relaxation Heavy-Ball Method: Achieving Global Accelerated Convergence with Broad Generalization
Jingrong Wei, Long Chen
The heavy-ball momentum method accelerates gradient descent with a momentum term but lacks accelerated convergence for general smooth strongly convex problems. This work introduces…