Adaptive Step-Size Methods for Compressed SGD

Adarsh M. Subramaniam, Akshayaa Magesh, Venugopal V. Veeravalli

Compressed Stochastic Gradient Descent (SGD) algorithms have been recently proposed to address the communication bottleneck in distributed and decentralized optimization problems,…