Adaptive Worker Grouping For Communication-Efficient and Straggler-Tolerant Distributed SGD

Feng Zhu, Jingjing Zhang, Osvaldo Simeone +1

Wall-clock convergence time and communication load are key performance metrics for the distributed implementation of stochastic gradient descent (SGD) in parameter server settings.…