13 citations · 68 across the 19 of their papers we have counts for
Showing 2022Show all
3 papers · 1 filter
cs.IT2022
Communication-Efficient Local SGD with Age-Based Worker Selection
Feng Zhu, Jingjing Zhang, Xin Wang
A major bottleneck of distributed learning under parameter-server (PS) framework is communication cost due to frequent bidirectional transmissions between the PS and workers. To ad…
cs.LG2022
STSyn: Speeding Up Local SGD with Straggler-Tolerant Synchronization
Feng Zhu, Jingjing Zhang, Xin Wang
Synchronous local stochastic gradient descent (local SGD) suffers from some workers being idle and random delays due to slow and straggling workers, as it waits for the workers to…
cs.IT2022
Adaptive Worker Grouping For Communication-Efficient and Straggler-Tolerant Distributed SGD
Feng Zhu, Jingjing Zhang, Osvaldo Simeone +1
Wall-clock convergence time and communication load are key performance metrics for the distributed implementation of stochastic gradient descent (SGD) in parameter server settings.…