Restart and Adaptive Acceleration in Stochastic Gradient Methods

Ali Elhishi, Chistophe Roux, Alexandre d'Aspremont

We study restart schemes in stochastic optimization problems for non-smooth and weakly convex that satisfy a Kurdyka-Łojasiewicz inequality. We show that using restarts allows us…