Understanding and Detecting Convergence for Stochastic Gradient Descent with Momentum

Jerry Chee, Ping Li

Convergence detection of iterative stochastic optimization methods is of great practical interest. This paper considers stochastic gradient descent (SGD) with a constant learning r…