An Augmented Lagrangian Approach to the Constrained Optimization Formulation of Imaging Inverse Problems

Abstract

We propose a new fast algorithm for solving one of the standard approaches to ill-posed linear inverse problems (IPLIP), where a (possibly non-smooth) regularizer is minimized under the constraint that the solution explains the observations sufficiently well. Although the regularizer and constraint are usually convex, several particular features of these problems (huge dimensionality, non-smoothness) preclude the use of off-the-shelf optimization tools and have stimulated a considerable amount of research. In this paper, we propose a new efficient algorithm to handle one class of constrained problems (often known as basis pursuit denoising) tailored to image recovery applications. The proposed algorithm, which belongs to the family of augmented Lagrangian methods, can be used to deal with a variety of imaging IPLIP, including deconvolution and reconstruction from compressive observations (such as MRI), using either total-variation or wavelet-based (or, more generally, frame-based) regularization. The proposed algorithm is an instance of the so-called "alternating direction method of multipliers", for which convergence sufficient conditions are known; we show that these conditions are satisfied by the proposed algorithm. Experiments on a set of image restoration and reconstruction benchmark problems show that the proposed algorithm is a strong contender for the state-of-the-art.

13 pages, 8 figure, 8 tables. Submitted to the IEEE Transactions on Image Processing

References in corpus (3)

• Fast Image Recovery Using Variable Splitting and Constrained Optimization
• Restoration of Poissonian Images Using Alternating Direction Optimization
• A Fast Algorithm for the Constrained Formulation of Compressive Image Reconstruction and Other Linear Inverse Problems

Cited by in corpus (64)

• A convex formulation for hyperspectral image superresolution via subspace-based regularization
• Hyperspectral and Multispectral Image Fusion based on a Sparse Representation
• Templates for Convex Cone Problems with Applications to Sparse Signal Recovery
• BM3D Frames and Variational Image Deblurring
• Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation
• Real-time Cardiovascular MR with Spatio-temporal Artifact Suppression using Deep Learning - Proof of Concept in Congenital Heart Disease
• Hyperspectral unmixing with spectral variability using a perturbed linear mixing model
• Distributed Basis Pursuit
• Convolutional Dictionary Learning: A Comparative Review and New Algorithms
• FastDeRain: A Novel Video Rain Streak Removal Method Using Directional Gradient Priors
• MuLoG, or How to apply Gaussian denoisers to multi-channel SAR speckle reduction?
• Deconvolving Images with Unknown Boundaries Using the Alternating Direction Method of Multipliers
• R-FUSE: Robust Fast Fusion of Multi-Band Images Based on Solving a Sylvester Equation
• Fixed Point Strategies in Data Science
• Compressed sensing for longitudinal MRI: An adaptive-weighted approach
• A Non-Local Structure Tensor Based Approach for Multicomponent Image Recovery Problems
• Split-and-augmented Gibbs sampler - Application to large-scale inference problems
• Deep Learning for space-variant deconvolution in galaxy surveys
• Resampling Images to a Regular Grid from a Non-Regular Subset of Pixel Positions Using Frequency Selective Reconstruction
• Compressive Spectral Image Reconstruction using Deep Prior and Low-Rank Tensor Representation
• Fast X-ray CT image reconstruction using the linearized augmented Lagrangian method with ordered subsets
• Pocket Guide to Solve Inverse Problems with GlobalBioIm
• Sparse Stochastic Processes and Discretization of Linear Inverse Problems
• A Data Dependent Multiscale Model for Hyperspectral Unmixing With Spectral Variability
• A Primal-Dual Proximal Algorithm for Sparse Template-Based Adaptive Filtering: Application to Seismic Multiple Removal
• Total variation with overlapping group sparsity for image deblurring under impulse noise
• Compressive Spectral Imaging with Diffractive Lenses
• High-Accuracy Total Variation for Compressed Video Sensing
• Graph Spatio-Spectral Total Variation Model for Hyperspectral Image Denoising
• A General Destriping Framework for Remote Sensing Images Using Flatness Constraint
• High-dimensional Gaussian sampling: a review and a unifying approach based on a stochastic proximal point algorithm
• Efficient Constrained Signal Reconstruction by Randomized Epigraphical Projection
• High Speed Compressed Sensing Reconstruction in Dynamic Parallel MRI Using Augmented Lagrangian and Parallel Processing
• Relaxing Tight Frame Condition in Parallel Proximal Methods for Signal Restoration
• High-resolution Multi-spectral Imaging with Diffractive Lenses and Learned Reconstruction
• Total Variation Applications in Computer Vision
• Rate-Distortion Modeling for Bit Rate Constrained Point Cloud Compression
• Deconvolution and Restoration of Optical Endomicroscopy Images
• Exploiting spatial sparsity for multi-wavelength imaging in optical interferometry
• A Framework for Fast Image Deconvolution with Incomplete Observations
• Complex-valued Imaging with Total Variation Regularization: An Application to Full-Waveform Inversion in Visco-acoustic Media
• Array SAR 3D Sparse Imaging Based on Regularization by Denoising Under Few Observed Data
• Periodic Splines and Gaussian Processes for the Resolution of Linear Inverse Problems
• A non-iterative method for the electrical impedance tomography based on joint sparse recovery
• Increasing Imaging Resolution by Non-Regular Sampling and Joint Sparse Deconvolution and Extrapolation
• Proximity Operators of Discrete Information Divergences
• Nonlinear stochastic partial differential equations with singular diffusivity and gradient Stratonovich noise
• Epigraphical Relaxation for Minimizing Layered Mixed Norms
• Widely Distributed Radar Imaging: Unmediated ADMM Based Approach
• Scientific machine learning in Hydrology: a unified perspective
• On-the-fly Approximation of Multivariate Total Variation Minimization
• Robust Hyperspectral Image Fusion with Simultaneous Guide Image Denoising via Constrained Convex Optimization
• Sparse distributed localized gradient fused features of objects
• A Novel Variational Approach for Multiphoton Microscopy Image Restoration: from PSF Estimation to 3D Deconvolution
• Robust Online Video Super-Resolution Using an Efficient Alternating Projections Scheme
• Robust Spatiotemporal Fusion of Satellite Images: A Constrained Convex Optimization Approach
• LSALSA: Accelerated Source Separation via Learned Sparse Coding
• Recursive Frequency Selective Reconstruction of Non-Regularly Sampled Video Data
• Guided Facial Skin Color Correction
• Pansharpening of PRISMA products for archaeological prospection
• Texture-Dependent Frequency Selective Reconstruction of Non-Regularly Sampled Images
• Composition-Aware Spectroscopic Tomography
• Using a Penalized Likelihood to Detect Mortality Deceleration
• JR2net: A Joint Non-Linear Representation and Recovery Network for Compressive Spectral Imaging