Problem-dependent convergence bounds for randomized linear gradient compression

Thomas Flynn, Patrick Johnstone, Shinjae Yoo

In distributed optimization, the communication of model updates can be a performance bottleneck. Consequently, gradient compression has been proposed as a means of increasing optim…