Asynchronous Distributed Optimization using a Randomized Alternating Direction Method of Multipliers

Abstract

Consider a set of networked agents endowed with private cost functions and seeking to find a consensus on the minimizer of the aggregate cost. A new class of random asynchronous distributed optimization methods is introduced. The methods generalize the standard Alternating Direction Method of Multipliers (ADMM) to an asynchronous setting where isolated components of the network are activated in an uncoordinated fashion. The algorithms rely on the introduction of randomized Gauss-Seidel iterations of a Douglas-Rachford operator for finding zeros of a sum of two monotone operators. Convergence to the sought minimizers is provided under mild connectivity conditions. Numerical results sustain our claims.

6 pages

Cited by in corpus (18)

• Global Convergence of ADMM in Nonconvex Nonsmooth Optimization
• Linear Time Average Consensus on Fixed Graphs and Implications for Decentralized Optimization and Multi-Agent Control
• On the O(1/k) Convergence of Asynchronous Distributed Alternating Direction Method of Multipliers
• Asynchronous Complex Analytics in a Distributed Dataflow Architecture
• Stochastic Quasi-Fejér Block-Coordinate Fixed Point Iterations with Random Sweeping
• Decentralized Consensus Optimization with Asynchrony and Delays
• A Class of Randomized Primal-Dual Algorithms for Distributed Optimization
• Asynchronous decentralized accelerated stochastic gradient descent
• Hybrid Voltage Control in Distribution Networks Under Limited Communication Rates
• Online Distributed ADMM on Networks
• A Fully-Distributed Asynchronous Approach for Multi-Area Coordinated Network-Constrained Unit Commitment
• A Generic online acceleration scheme for Optimization algorithms via Relaxation and Inertia
• Bregman Parallel Direction Method of Multipliers for Distributed Optimization via Mirror Averaging
• A Partition-Based Implementation of the Relaxed ADMM for Distributed Convex Optimization over Lossy Networks
• Testing fine-grained parallelism for the ADMM on a factor-graph
• Toward Creating Subsurface Camera
• Success and Failure of Adaptation-Diffusion Algorithms for Consensus in Multi-Agent Networks
• Asynchronous Multi-Task Learning