ADMM-Tracking Gradient for Distributed Optimization over Asynchronous and Unreliable Networks
arXiv:2309.14142 · doi:10.1109/TAC.2025.3539454
Abstract
In this paper, we propose a novel distributed algorithm for consensus optimization over networks and a robust extension tailored to deal with asynchronous agents and packet losses. Indeed, to robustly achieve dynamic consensus on the solution estimates and the global descent direction, we embed in our algorithms a distributed implementation of the Alternating Direction Method of Multipliers (ADMM). Such a mechanism is suitably interlaced with a local proportional action steering each agent estimate to the solution of the original consensus optimization problem. First, in the case of ideal networks, by using tools from system theory, we prove the linear convergence of the scheme with strongly convex costs. Then, by exploiting the averaging theory, we extend such a first result to prove that the robust extension of our method preserves linear convergence in the case of asynchronous agents and packet losses. Further, by using the notion of Input-to-State Stability, we also guarantee the robustness of the schemes with respect to additional, generic errors affecting the agents' updates. Finally, some numerical simulations confirm our theoretical findings and compare our algorithms with other distributed schemes in terms of speed and robustness.
References in corpus (15)
- D-ADMM: A Communication-Efficient Distributed Algorithm For Separable Optimization
- ARock: an Algorithmic Framework for Asynchronous Parallel Coordinate Updates
- Asynchronous Distributed ADMM for Large-Scale Optimization- Part I: Algorithm and Convergence Analysis
- ADD-OPT: Accelerated Distributed Directed Optimization
- A Proximal Dual Consensus ADMM Method for Multi-Agent Constrained Optimization
- Distributed Optimization for Smart Cyber-Physical Networks
- Asynchronous Distributed Optimization over Lossy Networks via Relaxed ADMM: Stability and Linear Convergence
- Coordinate Friendly Structures, Algorithms and Applications
- Lyapunov Theory for Discrete Time Systems
- Analysis of Distributed ADMM Algorithm for Consensus Optimization in Presence of Node Error
- Can Primal Methods Outperform Primal-dual Methods in Decentralized Dynamic Optimization?
- Tracking-based distributed equilibrium seeking for aggregative games
- A System Theoretical Perspective to Gradient-Tracking Algorithms for Distributed Quadratic Optimization
- Variance Reduced EXTRA and DIGing and Their Optimal Acceleration for Strongly Convex Decentralized Optimization
- (Corrected Version) Push-LSVRG-UP: Distributed Stochastic Optimization over Unbalanced Directed Networks with Uncoordinated Triggered Probabilities