Error Compensated Loopless SVRG, Quartz, and SDCA for Distributed Optimization

Xun Qian, Hanze Dong, Peter Richtárik +1

The communication of gradients is a key bottleneck in distributed training of large scale machine learning models. In order to reduce the communication cost, gradient compression (…