261 citations · 503 across the 19 of their papers we have counts for
9 papers · 1 filter
Communication-Efficient Topologies for Decentralized Learning with Consensus Rate
Zhuoqing Song, Weijian Li, Kexin Jin +4
Decentralized optimization is an emerging paradigm in distributed learning in which agents achieve network-wide solutions by peer-to-peer communication without the central server.…
Optimal Gradient Tracking for Decentralized Optimization
Zhuoqing Song, Lei Shi, Shi Pu +1
In this paper, we focus on solving the decentralized optimization problem of minimizing the sum of objective functions over a multi-agent network. The agents are embedded in an…
Provably Accelerated Decentralized Gradient Method Over Unbalanced Directed Graphs
Zhuoqing Song, Lei Shi, Shi Pu +1
We consider the decentralized optimization problem, where a network of agents aims to collaboratively minimize the average of their individual smooth and convex objective funct…
A Multi-Agent Primal-Dual Strategy for Composite Optimization over Distributed Features
Sulaiman A. Alghunaim, Ming Yan, Ali H. Sayed
This work studies multi-agent sharing optimization problems with the objective function being the sum of smooth local functions plus a convex (possibly non-smooth) function couplin…
On linear convergence of two decentralized algorithms
Yao Li, Ming Yan
Decentralized algorithms solve multi-agent problems over a connected network, where the information can only be exchanged with the accessible neighbors. Though there exist several…
New convergence analysis of a primal-dual algorithm with large stepsizes
Zhi Li, Ming Yan
We consider a primal-dual algorithm for minimizing with Fréchet differentiable and . This primal-dual algorithm has two names in literature: Primal-D…
A decentralized proximal-gradient method with network independent step-sizes and separated convergence rates
Zhi Li, Wei Shi, Ming Yan
This paper proposes a novel proximal-gradient algorithm for a decentralized optimization problem with a composite objective containing smooth and non-smooth terms. Specifically, th…
On the Convergence of Asynchronous Parallel Iteration with Unbounded Delays
Zhimin Peng, Yangyang Xu, Ming Yan +1
Recent years have witnessed the surge of asynchronous parallel (async-parallel) iterative algorithms due to problems involving very large-scale data and a large number of decision…
Self Equivalence of the Alternating Direction Method of Multipliers
Ming Yan, Wotao Yin
The alternating direction method of multipliers (ADM or ADMM) breaks a complex optimization problem into much simpler subproblems. The ADM algorithms are typically short and easy t…