2 papers
cs.LG2022
STSyn: Speeding Up Local SGD with Straggler-Tolerant Synchronization
Feng Zhu, Jingjing Zhang, Xin Wang
Synchronous local stochastic gradient descent (local SGD) suffers from some workers being idle and random delays due to slow and straggling workers, as it waits for the workers to…
cs.IT2022
Adaptive Worker Grouping For Communication-Efficient and Straggler-Tolerant Distributed SGD
Feng Zhu, Jingjing Zhang, Osvaldo Simeone +1
Wall-clock convergence time and communication load are key performance metrics for the distributed implementation of stochastic gradient descent (SGD) in parameter server settings.…