The Error-Feedback Framework: Better Rates for SGD with Delayed Gradients and Compressed Communication

Sebastian U. Stich, Sai Praneeth Karimireddy

We analyze (stochastic) gradient descent (SGD) with delayed updates on smooth quasi-convex and non-convex functions and derive concise, non-asymptotic, convergence rates. We show t…