Unified Analysis of Stochastic Gradient Methods for Composite Convex and Smooth Optimization

Ahmed Khaled, Othmane Sebbouh, Nicolas Loizou +2

We present a unified theorem for the convergence analysis of stochastic gradient algorithms for minimizing a smooth and convex loss plus a convex regularizer. We do this by extendi…