Communication-Efficient Distributed Learning with Local Immediate Error Compensation

Yifei Cheng, Li Shen, Linli Xu +6

Gradient compression with error compensation has attracted significant attention with the target of reducing the heavy communication overhead in distributed learning. However, exis…