Last-iterate convergence analysis of stochastic momentum methods for neural networks

Dongpo Xu, Jinlan Liu, Yinghua Lu +2

The stochastic momentum method is a commonly used acceleration technique for solving large-scale stochastic optimization problems in artificial neural networks. Current convergence…