Catalyst Acceleration of Error Compensated Methods Leads to Better Communication Complexity

Xun Qian, Hanze Dong, Tong Zhang +1

Communication overhead is well known to be a key bottleneck in large scale distributed learning, and a particularly successful class of methods which help to overcome this bottlene…