activity
20192022
most citedA Double Residual Compression Algorithm for Efficient Distributed Learning

29 citations · 49 across the 6 of their papers we have counts for

collaborators

6 papers

math.OC2022★ 1 cited

On the improved conditions for some primal-dual algorithms

Yao Li, Ming Yan

The convex minimization of over with differentiable and linear operator $\mathbf{A}: \mathbb{R}^n\rightarro…

cs.LG2021★ 4 cited

Decentralized Composite Optimization with Compression

Yao Li, Xiaorui Liu, Jiliang Tang +2

Decentralized optimization and communication compression have exhibited their great potential in accelerating distributed machine learning by mitigating the communication bottlenec…

cs.DC2021★ 2 cited

ErrorCompensatedX: error compensation for variance reduced algorithms

Hanlin Tang, Yao Li, Ji Liu +1

Communication cost is one major bottleneck for the scalability for distributed learning. One approach to reduce the communication cost is to compress the gradient during communicat…

cs.LG2020★ 12 cited

Linear Convergent Decentralized Optimization with Compression

Xiaorui Liu, Yao Li, Rongrong Wang +2

Communication compression has become a key strategy to speed up distributed optimization. However, existing decentralized algorithms with compression mainly focus on compressing DG…

cs.LG2019★ 29 cited

A Double Residual Compression Algorithm for Efficient Distributed Learning

Xiaorui Liu, Yao Li, Jiliang Tang +1

Large-scale machine learning models are often trained by parallel stochastic gradient descent algorithms. However, the communication cost of gradient aggregation and model synchron…

math.OC2019★ 1 cited

On linear convergence of two decentralized algorithms

Yao Li, Ming Yan

Decentralized algorithms solve multi-agent problems over a connected network, where the information can only be exchanged with the accessible neighbors. Though there exist several…