Showing 2025Show all
2 papers · 1 filter
math.OC2025
Stochastic versus Deterministic in Stochastic Gradient Descent
Runze Li, Jintao Xu, Wenxun Xing
This paper theoretically reanalyzes the convergence of the mini-batch stochastic gradient descent (SGD) for a structured minimization problem involving a finite-sum function with i…
math.OC2025
Depth-first directional search for nonconvex optimization
Yuxuan Zhang, Wenxun Xing
Random search methods are widely used for global optimization due to their theoretical generality and implementation simplicity. This paper proposes a depth-first directional searc…