Eigen-componentwise convergence of SGD on quadratic programming

Lehan Chen, Yuji Nakatsukasa

Stochastic gradient descent (SGD) is a workhorse algorithm for solving large-scale optimization problems in data science and machine learning. Understanding the convergence of SGD…