12 citations · 18 across the 7 of their papers we have counts for
Showing 2021Show all
3 papers · 1 filter
cs.DC2021
Decentralized optimization with non-identical sampling in presence of stragglers
Tharindu Adikari, Stark Draper
We consider decentralized consensus optimization when workers sample data from non-identical distributions and perform variable amounts of work due to slow nodes known as straggler…
cs.DC2021
Rate distortion comparison of a few gradient quantizers
Tharindu Adikari
This article is in the context of gradient compression. Gradient compression is a popular technique for mitigating the communication bottleneck observed when training large machine…
cs.LG2021★ 3 cited
Compressing gradients by exploiting temporal correlation in momentum-SGD
Tharindu B. Adikari, Stark C. Draper
An increasing bottleneck in decentralized optimization is communication. Bigger models and growing datasets mean that decentralization of computation is important and that the amou…