An Asymptotic Analysis of Minibatch-Based Momentum Methods for Linear Regression Models

Yuan Gao, Xuening Zhu, Haobo Qi +3

Momentum methods have been shown to accelerate the convergence of the standard gradient descent algorithm in practice and theory. In particular, the minibatch-based gradient descen…