110 citations · 489 across the 29 of their papers we have counts for
1 paper · 2 filters
Minjun Zhao, Yichen Yin, Yuren Mao +3
Top-k sparsification has recently been widely used to reduce the communication volume in distributed deep learning. However, due to the Sparse Gradient Accumulation (SGA) dilemma,…