Delayed supermartingale convergence lemmas for stochastic approximation with Nesterov momentum

Zhang Ming-Kun

This paper focus on the convergence of stochastic approximation with Nesterov momentum. Nesterov acceleration has proven effective in machine learning for its ability to reduce com…