Showing math.OCShow all
3 papers · 1 filter
math.OC2026
Stochastic versus Deterministic in Stochastic Gradient Descent
Runze Li, Jintao Xu, Wenxun Xing
This paper theoretically reanalyzes the convergence of the mini-batch stochastic gradient descent (SGD) for a structured minimization problem involving a finite-sum function with i…
math.OC2025
Depth-first directional search for nonconvex optimization
Yuxuan Zhang, Wenxun Xing
Random search methods are widely used for global optimization due to their theoretical generality and implementation simplicity. This paper proposes a depth-first directional searc…
math.OC2025
Stable gradient-adjusted root mean square propagation on least squares problem
Runze Li, Jintao Xu, Wenxun Xing
Root mean square propagation (abbreviated as RMSProp) is a first-order stochastic algorithm used in machine learning widely. In this paper, a stable gradient-adjusted RMSProp (abbr…