261 citations · 503 across the 19 of their papers we have counts for
4 papers · 1 filter
Decentralized Composite Optimization with Compression
Yao Li, Xiaorui Liu, Jiliang Tang +2
Decentralized optimization and communication compression have exhibited their great potential in accelerating distributed machine learning by mitigating the communication bottlenec…
Linear Convergent Decentralized Optimization with Compression
Xiaorui Liu, Yao Li, Rongrong Wang +2
Communication compression has become a key strategy to speed up distributed optimization. However, existing decentralized algorithms with compression mainly focus on compressing DG…
Manifold Denoising by Nonlinear Robust Principal Component Analysis
He Lyu, Ningyu Sha, Shuyang Qin +3
This paper extends robust principal component analysis (RPCA) to nonlinear manifolds. Suppose that the observed data matrix is the sum of a sparse component and a component drawn f…
A Double Residual Compression Algorithm for Efficient Distributed Learning
Xiaorui Liu, Yao Li, Jiliang Tang +1
Large-scale machine learning models are often trained by parallel stochastic gradient descent algorithms. However, the communication cost of gradient aggregation and model synchron…