2 papers
math.OC2023
Stochastic Conjugate Frameworks for Nonconvex and Nonsmooth Optimization
Jiangshan Wang, Zheng Peng
We introduce two new stochastic conjugate frameworks for a class of nonconvex and possibly also nonsmooth optimization problems. These frameworks are built upon Stochastic Recursiv…
math.OC2023
Accelerating Stochastic Recursive and Semi-stochastic Gradient Methods with Adaptive Barzilai-Borwein Step Sizes
Jiangshan Wang, Yiming Yang, Zheng Peng
The mini-batch versions of StochAstic Recursive grAdient algoritHm and Semi-Stochastic Gradient Descent method, employed the random Barzilai-Borwein step sizes (shorted as MB-SARAH…