66 citations · 283 across the 24 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.DC2021★ 12 cited
BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning
Bicheng Ying, Kun Yuan, Hanbin Hu +2
Decentralized algorithm is a form of computation that achieves a global goal through local dynamics that relies on low-cost communication between directly-connected agents. On larg…
cs.LG2021★ 5 cited
Exponential Graph is Provably Efficient for Decentralized Deep Training
Bicheng Ying, Kun Yuan, Yiming Chen +3
Decentralized SGD is an emerging training method for deep learning known for its much less (thus faster) communication per iteration, which relaxes the averaging step in parallel S…