Communication-Efficient Distributed SGD with Error-Feedback, Revisited

Tran Thi Phuong, Le Trieu Phong

We show that the convergence proof of a recent algorithm called dist-EF-SGD for distributed stochastic gradient descent with communication efficiency using error-feedback of Zheng…