On the Convergence of Quantized Parallel Restarted SGD for Central Server Free Distributed Training

Feijie Wu, Shiqi He, Yutong Yang +4

Communication is a crucial phase in the context of distributed training. Because parameter server (PS) frequently experiences network congestion, recent studies have found that tra…