1 paper · 1 filter
Minjun Zhao, Yichen Yin, Yuren Mao +3
Top-k sparsification has recently been widely used to reduce the communication volume in distributed deep learning. However, due to the Sparse Gradient Accumulation (SGA) dilemma,…