A Stochastic Gradient Method with Biased Estimation for Faster Nonconvex Optimization

Jia Bi, Steve R. Gunn

A number of optimization approaches have been proposed for optimizing nonconvex objectives (e.g. deep learning models), such as batch gradient descent, stochastic gradient descent…