A Short Survey of Averaging Techniques in Stochastic Gradient Methods

K. Lakshmanan

Stochastic gradient methods are among the most widely used algorithms for large-scale optimization and machine learning. A key technique for improving the statistical efficiency an…