Showing math.OCShow all
2 papers · 1 filter
math.OC2026
Stochastic versus Deterministic in Stochastic Gradient Descent
Runze Li, Jintao Xu, Wenxun Xing
This paper theoretically reanalyzes the convergence of the mini-batch stochastic gradient descent (SGD) for a structured minimization problem involving a finite-sum function with i…
math.OC2025
Stable gradient-adjusted root mean square propagation on least squares problem
Runze Li, Jintao Xu, Wenxun Xing
Root mean square propagation (abbreviated as RMSProp) is a first-order stochastic algorithm used in machine learning widely. In this paper, a stable gradient-adjusted RMSProp (abbr…