Douglas-Rachford splitting and ADMM for nonconvex optimization: Accelerated and Newton-type linesearch algorithms
arXiv:2005.10230 · doi:10.1007/s10589-022-00366-y
Abstract
Although the performance of popular optimization algorithms such as Douglas-Rachford splitting (DRS) and the ADMM is satisfactory in small and well-scaled problems, ill conditioning and problem size pose a severe obstacle to their reliable employment. Expanding on recent convergence results for DRS and ADMM applied to nonconvex problems, we propose two linesearch algorithms to enhance and robustify these methods by means of quasi-Newton directions. The proposed algorithms are suited for nonconvex problems, require the same black-box oracle of DRS and ADMM, and maintain their (subsequential) convergence properties. Numerical evidence shows that the employment of L-BFGS in the proposed framework greatly improves convergence of DRS and ADMM, making them robust to ill conditioning. Under regularity and nondegeneracy assumptions at the limit point, superlinear convergence is shown when quasi-Newton Broyden directions are adopted.
References in corpus (10)
- Global convergence of splitting methods for nonconvex composite optimization
- Douglas-Rachford splitting for nonconvex optimization with application to nonconvex feasibility problems
- Forward-backward quasi-Newton methods for nonsmooth optimization problems
- Forward-backward envelope for the sum of two nonconvex functions: Further properties and nonmonotone line-search algorithms
- Douglas-Rachford splitting and ADMM for nonconvex optimization: tight convergence results
- Alternating Projections and Douglas-Rachford for Sparse Affine Feasibility
- Self Equivalence of the Alternating Direction Method of Multipliers
- SuperMann: a superlinearly convergent algorithm for finding fixed points of nonexpansive operators
- On the acceleration of forward-backward splitting via an inexact Newton method
- Newton-type Alternating Minimization Algorithm for Convex Optimization
Cited by in corpus (3)
- Optimal Grid Layouts for Hybrid Offshore Assets in the North Sea under Different Market Designs
- Safeguarding adaptive methods: global convergence of Barzilai-Borwein and other stepsize choices
- A mirror inertial forward-reflected-backward splitting: Global convergence and linesearch extension beyond convexity and Lipschitz smoothness