Stochastic optimization with momentum: convergence, fluctuations, and traps avoidance

A. Barakat, P. Bianchi, W. Hachem +1

In this paper, a general stochastic optimization procedure is studied, unifying several variants of the stochastic gradient descent such as, among others, the stochastic heavy ball…