A Proximal Dual Consensus ADMM Method for Multi-Agent Constrained Optimization
arXiv:1409.3307 · doi:10.1109/TSP.2016.2544743
Abstract
This paper studies efficient distributed optimization methods for multi-agent networks. Specifically, we consider a convex optimization problem with a globally coupled linear equality constraint and local polyhedra constraints, and develop distributed optimization methods based on the alternating direction method of multipliers (ADMM). The considered problem has many applications in machine learning and smart grid control problems. Due to the presence of the polyhedra constraints, agents in the existing methods have to deal with polyhedra constrained subproblems at each iteration. One of the key issues is that projection onto a polyhedra constraint is not trivial, which prohibits from closed-form solutions or the use of simple algorithms for solving these subproblems. In this paper, by judiciously integrating the proximal minimization method with ADMM, we propose a new distributed optimization method where the polyhedra constraints are handled softly as penalty terms in the subproblems. This makes the subproblems efficiently solvable and consequently reduces the overall computation time. Furthermore, we propose a randomized counterpart that is robust against randomly ON/OFF agents and imperfect communication links. We analytically show that both the proposed methods have a worst-case convergence rate, where is the iteration number. Numerical results show that the proposed methods offer considerably lower computation time than the existing distributed ADMM method.
submitted to IEEE Transactions on Signal Processing
References in corpus (2)
Cited by in corpus (21)
- Distributed Optimization for Smart Cyber-Physical Networks
- An Asynchronous, Decentralized Solution Framework for the Large Scale Unit Commitment Problem
- A Distributed, Asynchronous and Incremental Algorithm for Nonconvex Optimization: An ADMM Based Approach
- Decentralized Resource Allocation via Dual Consensus ADMM
- Decentralized Sparse Multitask RLS over Networks
- Convergence Analysis of Alternating Direction Method of Multipliers for a Family of Nonconvex Problems
- Stochastic Proximal Gradient Consensus Over Random Networks
- ADMM-Tracking Gradient for Distributed Optimization over Asynchronous and Unreliable Networks
- Distributed Augmented Lagrangian Method for Link-Based Resource Sharing Problems of Multi-Agent Systems
- Composite Optimization with Coupling Constraints via Dual Proximal Gradient Method with Applications to Asynchronous Networks
- HVAC Energy Cost Optimization for a Multi-zone Building via a Decentralized Approach
- Supervised MPC control of large-scale electricity networks via clustering methods
- Toward Model Parallelism for Deep Neural Network based on Gradient-free ADMM Framework
- Distributed Convex Optimization With Coupling Constraints Over Time-Varying Directed Graphs
- Decentralized and Equitable Optimal Transport
- Decentralized Non-Convex Learning with Linearly Coupled Constraints
- S-DIGing: A Stochastic Gradient Tracking Algorithm for Distributed Optimization
- Controlling Power and Virtual Inertia from Storage for Frequency Response
- Distributed Linearized ADMM for Network Cost Minimization
- A Distributed Methodology for Approximate Uniform Global Minimum Sharing
- Dynamic Sharing Through the ADMM