Distributed Constrained Optimization by Consensus-Based Primal-Dual Perturbation Method
arXiv:1304.5590 · doi:10.1109/TAC.2014.2308612
Abstract
Various distributed optimization methods have been developed for solving problems which have simple local constraint sets and whose objective function is the sum of local cost functions of distributed agents in a network. Motivated by emerging applications in smart grid and distributed sparse regression, this paper studies distributed optimization methods for solving general problems which have a coupled global cost function and have inequality constraints. We consider a network scenario where each agent has no global knowledge and can access only its local mapping and constraint functions. To solve this problem in a distributed manner, we propose a consensus-based distributed primal-dual perturbation (PDP) algorithm. In the algorithm, agents employ the average consensus technique to estimate the global cost and constraint functions via exchanging messages with neighbors, and meanwhile use a local primal-dual perturbed subgradient method to approach a global optimum. The proposed PDP method not only can handle smooth inequality constraints but also non-smooth constraints such as some sparsity promoting constraints arising in sparse optimization. We prove that the proposed PDP algorithm converges to an optimal primal-dual solution of the original problem, under standard problem and network assumptions. Numerical results illustrating the performance of the proposed algorithm for a distributed demand response control problem in smart grid are also presented.
32 pages; Revised and submitted to IEEE TRANSACTIONS ON Automatic Control
Cited by in corpus (56)
- Multi-Agent Distributed Optimization via Inexact Consensus ADMM
- Asynchronous Distributed ADMM for Large-Scale Optimization- Part I: Algorithm and Convergence Analysis
- Decentralized Charging Control of Electric Vehicles in Residential Distribution Networks
- A Novel Consensus-based Distributed Algorithm for Economic Dispatch Based on Local Estimation of Power Mismatch
- A Proximal Dual Consensus ADMM Method for Multi-Agent Constrained Optimization
- Multi-Stage Hybrid Federated Learning over Large-Scale D2D-Enabled Fog Networks
- Distributed Optimization for Smart Cyber-Physical Networks
- Dictionary Learning over Distributed Models
- Decentralized Frank-Wolfe Algorithm for Convex and Non-convex Problems
- Supervised Learning Under Distributed Features
- A Primal-Dual Quasi-Newton Method for Exact Consensus Optimization
- Analysis of Distributed ADMM Algorithm for Consensus Optimization in Presence of Node Error
- GADMM: Fast and Communication Efficient Framework for Distributed Machine Learning
- A Distributed Asynchronous Method of Multipliers for Constrained Nonconvex Optimization
- Coordinate Dual Averaging for Decentralized Online Optimization with Nonseparable Global Objectives
- Distributed Constrained Online Learning
- Automated Linear Function Submission-based Double Auction as Bottom-up Real-Time Pricing in a Regional Prosumers' Electricity Network
- Distributed Regularized Primal-Dual Method: Convergence Analysis and Trade-offs
- A Distributed Algorithm for Least Square Solutions of Linear Equations
- Distributed Online Optimization for Multi-Agent Networks with Coupled Inequality Constraints
- Communication-Efficient Algorithms for Decentralized and Stochastic Optimization
- A Distributed Algorithm for Solving a Linear Algebraic Equation
- Multi-Agent Safe Policy Learning for Power Management of Networked Microgrids
- Distributed Aggregative Optimization over Multi-Agent Networks
- Optimal Clearing Payments in a Financial Contagion Model
- Optimal Distributed Stochastic Mirror Descent for Strongly Convex Optimization
- Passivity-Based Distributed Optimization with Communication Delays Using PI Consensus Algorithm
- Communication-Efficient Algorithms For Distributed Optimization
- A primal-dual method for conic constrained distributed optimization problems
- Composite Optimization with Coupling Constraints via Dual Proximal Gradient Method with Applications to Asynchronous Networks
- Distributed Proximal Algorithms for Multi-Agent Optimization with Coupled Inequality Constraints
- Distributed Nonsmooth Robust Resource Allocation with Cardinality Constrained Uncertainty
- Distributed Mirror Descent for Online Composite Optimization
- Linearly Convergent Algorithm with Variance Reduction for Distributed Stochastic Optimization
- A Double-Layered Framework for Distributed Coordination in Solving Linear Equations
- Energy management for building district cooling: a distributed approach to resource sharing
- Primal-Dual Algorithm for Distributed Constrained Optimization
- A Unification and Generalization of Exact Distributed First Order Methods
- Dual decomposition for multi-agent distributed optimization with coupling constraints
- Grand Challenges in Resilience: Autonomous System Resilience through Design and Runtime Measures
- Decentralized Non-Convex Learning with Linearly Coupled Constraints
- Cloud-aided collaborative estimation by ADMM-RLS algorithms for connected vehicle prognostics
- Energy Efficient Massive MIMO through Distributed Precoder Design
- Distributed Multi-resource Allocation with Little Communication Overhead
- Exponential Convergence of a Distributed Algorithm for Solving Linear Algebraic Equations
- Network Utility Maximization based on Incentive Mechanism for Truthful Reporting of Local Information
- Distributed Regularized Dual Gradient Algorithm for Constrained Convex Optimization over Time-Varying Directed Graphs
- A Smooth Double Proximal Primal-Dual Algorithm for a Class of Distributed Nonsmooth Optimization Problem
- Convergence of the Augmented Decomposition Algorithm
- Discriminatory Price Mechanism for Smart Grid
- Asynchronous Parallel Nonconvex Optimization Under the Polyak-Lojasiewicz Condition
- Fast-Convergent Dynamics for Distributed Allocation of Resources Over Switching Sparse Networks with Quantized Communication Links
- Asymptotic Properties of Primal-Dual Algorithm for Distributed Stochastic Optimization Over Random Networks
- A Distributed Methodology for Approximate Uniform Global Minimum Sharing
- Distributed Nonsmooth Optimization with Coupled Inequality Constraints via Modified Lagrangian Function
- An Iterative Mechanism for Coupling Electricity Markets