Showing 2024Show all
2 papers · 1 filter
cs.DC2024
Adaptive Weighting Push-SUM for Decentralized Optimization with Statistical Diversity
Yiming Zhou, Yifei Cheng, Linli Xu +1
Statistical diversity is a property of data distribution and can hinder the optimization of a decentralized network. However, the theoretical limitations of the Push-SUM protocol r…
cs.LG2024
Communication-Efficient Distributed Learning with Local Immediate Error Compensation
Yifei Cheng, Li Shen, Linli Xu +6
Gradient compression with error compensation has attracted significant attention with the target of reducing the heavy communication overhead in distributed learning. However, exis…