Stochastic Gradient Descent in the Viewpoint of Graduated Optimization

Da Li, Jingjing Wu, Qingrun Zhang

Stochastic gradient descent (SGD) method is popular for solving non-convex optimization problems in machine learning. This work investigates SGD from a viewpoint of graduated optim…