Optimal parameter selection for the alternating direction method of multipliers (ADMM): quadratic problems

Abstract

The alternating direction method of multipliers (ADMM) has emerged as a powerful technique for large-scale structured optimization. Despite many recent results on the convergence properties of ADMM, a quantitative characterization of the impact of the algorithm parameters on the convergence times of the method is still lacking. In this paper we find the optimal algorithm parameters that minimize the convergence factor of the ADMM iterates in the context of l2-regularized minimization and constrained quadratic programming. Numerical examples show that our parameter selection rules significantly outperform existing alternatives in the literature.

Submitted to IEEE Transactions on Automatic Control

References in corpus (1)

• On the Linear Convergence of the ADMM in Decentralized Consensus Optimization

Cited by in corpus (29)

• OSQP: An Operator Splitting Solver for Quadratic Programs
• Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation
• Distributed Optimal Power Flow Algorithm for Balanced Radial Distribution Networks
• A Flexible and Efficient Algorithmic Framework for Constrained Matrix and Tensor Factorization
• DQM: Decentralized Quadratically Approximated Alternating Direction Method of Multipliers
• Asynchronous Distributed Optimization over Lossy Networks via Relaxed ADMM: Stability and Linear Convergence
• Phase Retrieval from 1D Fourier Measurements: Convexity, Uniqueness, and Algorithms
• Characterizing Magnetized Plasmas with Dynamic Mode Decomposition
• Multi-block ADMM Heuristics for Mixed-Binary Optimization on Classical and Quantum Computers
• Quantized Consensus ADMM for Multi-Agent Distributed Optimization
• Chordal decomposition in operator-splitting methods for sparse semidefinite programs
• Quantized Consensus by the ADMM: Probabilistic versus Deterministic Quantizers
• Undersampled Phase Retrieval with Outliers
• The Analysis of Optimization Algorithms, A Dissipativity Approach
• A Flexible Optimization Framework for Regularized Matrix-Tensor Factorizations with Linear Couplings
• A Fair and Privacy-Aware EV Discharging Strategy using Decentralized Whale Optimization Algorithm for Minimizing Cost of EVs and the EV Aggregator
• Distributed Optimization over Lossy Networks via Relaxed Peaceman-Rachford Splitting: a Robust ADMM Approach
• An Explicit Rate Bound for the Over-Relaxed ADMM
• The Application of Preconditioned Alternating Direction Method of Multipliers in Depth from Focal Stack
• GMRES-Accelerated ADMM for Quadratic Objectives
• Barrier-Enhanced Parallel Homotopic Trajectory Optimization for Safety-Critical Autonomous Driving
• $\pi$-MPPI: A Projection-based Model Predictive Path Integral Scheme for Smooth Optimal Control of Fixed-Wing Aerial Vehicles
• Markov Chain Lifting and Distributed ADMM
• Parameter Estimation with the Ordered ${\ell }_2$ Regularization via an Alternating Direction Method of Multipliers
• The Alternating Direction Method of Multipliers for Finding the Distance between Ellipsoids
• Multi-Objective Agent-Based Model Predictive Controller for Plug-and-Play Vehicle Control
• Sparse outlier-robust PCA for multi-source data
• Asymptotic Performance Prediction for ADMM-Based Compressed Sensing
• A Data-Driven Distributed Control Scheme: Learning Multi-Objective Agent-Based MPC for Path-Tracking