2 papers
cs.LG2021
A Variance Controlled Stochastic Method with Biased Estimation for Faster Non-convex Optimization
Jia Bi, Steve R. Gunn
In this paper, we proposed a new technique, {\em variance controlled stochastic gradient} (VCSG), to improve the performance of the stochastic variance reduced gradient (SVRG) algo…
cs.LG2019
A Stochastic Gradient Method with Biased Estimation for Faster Nonconvex Optimization
Jia Bi, Steve R. Gunn
A number of optimization approaches have been proposed for optimizing nonconvex objectives (e.g. deep learning models), such as batch gradient descent, stochastic gradient descent…