Proximal Gradient Algorithms: Applications in Signal Processing
arXiv:1803.01621
Abstract
Advances in numerical optimization have supported breakthroughs in several areas of signal processing. This paper focuses on the recent enhanced variants of the proximal gradient numerical optimization algorithm, which combine quasi-Newton methods with forward-adjoint oracles to tackle large-scale problems and reduce the computational burden of many applications. These proximal gradient algorithms are here described in an easy-to-understand way, illustrating how they are able to address a wide variety of problems arising in signal processing. A new high-level modeling language is presented which is used to demonstrate the versatility of the presented algorithms in a series of signal processing application examples such as sparse deconvolution, total variation denoising, audio de-clipping and others.
arXiv comment30 pages, 14 figures
References in corpus (8)
- Convex Optimization for Big Data
- Self-Calibration and Biconvex Compressive Sensing
- Splitting methods with variable metric for KL functions
- Forward-backward quasi-Newton methods for nonsmooth optimization problems
- Forward-backward envelope for the sum of two nonconvex functions: Further properties and nonmonotone line-search algorithms
- A quasi-Newton proximal splitting method
- Forward-backward truncated Newton methods for convex composite optimization
- On the acceleration of forward-backward splitting via an inexact Newton method
Cited by in corpus (6)
- Structured LISTA for Multidimensional Harmonic Retrieval
- Square root-based multi-source early PSD estimation and recursive RETF update in reverberant environments by means of the orthogonal Procrustes problem
- Algorithms and software for projections onto intersections of convex and non-convex sets with applications to inverse problems
- Proximal Newton Methods for X-Ray Imaging with Non-Smooth Regularization
- Discrete-Aware Matrix Completion via Proximal Gradient
- Theoretical Linear Convergence of Deep Unfolding Network for Block-Sparse Signal Recovery