Convergence of Gradient Algorithms for Nonconvex C^{1+alpha} Cost Functions

Zixuan Wang, Shanjian Tang

This paper is concerned with convergence of stochastic gradient algorithms with momentum terms in the nonconvex setting. A class of stochastic momentum methods, including stochasti…