Showing math.OCShow all
2 papers · 1 filter
math.OC2026
Asymptotic Convergence and Stability of Adaptive Gradient Methods in Smooth Non-convex Optimization
Ruinan Jin, Xiaoyu Wang
Adaptive gradient methods, such as AdaGrad, have become fundamental tools in deep learning. Despite their widespread use, the asymptotic convergence of AdaGrad remains poorly under…
math.OC2024
Stability and convergence analysis of AdaGrad for non-convex optimization via novel stopping time-based techniques
Ruinan Jin, Xiaoyu Wang, Baoxiang Wang
Adaptive gradient optimizers (AdaGrad), which dynamically adjust the learning rate based on iterative gradients, have emerged as powerful tools in deep learning. These adaptive met…