Restart and Adaptive Acceleration in Stochastic Gradient Methods

Ali Elhishi, Chistophe Roux, Alexandre d'Aspremont

We study restart schemes in stochastic optimization problems for non-smooth and weakly convex functions that satisfy a Kurdyka-Łojasiewicz (KŁ) inequality. Using restarts allows us…