Communication-Efficient Approximate Gradient Coding for Distributed Learning in Heterogeneous Systems

Heekang Song, Wan Choi

We propose a communication-efficient optimally structured gradient coding scheme to jointly address straggler resilience and communication efficiency in heterogeneous distributed l…