Compressed Communication for Distributed Training: Adaptive Methods and System

Yuchen Zhong, Cong Xie, Shuai Zheng +1

Communication overhead severely hinders the scalability of distributed machine learning systems. Recently, there has been a growing interest in using gradient compression to reduce…