178 citations · 987 across the 31 of their papers we have counts for
Showing 2019 · cs.DCShow all
2 papers · 2 filters
cs.DC2019★ 23 cited
: Decentralization Meets Error-Compensated Compression
Hanlin Tang, Xiangru Lian, Shuang Qiu +4
Communication is a key bottleneck in distributed training. Recently, an \emph{error-compensated} compression technology was particularly designed for the \emph{centralized} learnin…
cs.DC2019★ 114 cited
DoubleSqueeze: Parallel Stochastic Gradient Descent with Double-Pass Error-Compensated Compression
Hanlin Tang, Xiangru Lian, Chen Yu +2
A standard approach in large scale machine learning is distributed stochastic gradient training, which requires the computation of aggregated stochastic gradients over multiple nod…