Cooperative Gradient Coding

Shudi Weng, Ming Xiao, Chao Ren +1

This work studies gradient coding (GC) in the context of distributed training problems with unreliable communication. We propose cooperative GC (CoGC), a novel gradient-sharing-bas…