Convergence Guarantees for Non-Convex Optimisation with Cauchy-Based Penalties

Abstract

In this paper, we propose a proximal splitting methodology with a non-convex penalty function based on the heavy-tailed Cauchy distribution. We first suggest a closed-form expression for calculating the proximal operator of the Cauchy prior, which then makes it applicable in generic proximal splitting algorithms. We further derive the condition required for guaranteed convergence to a solution in optimisation problems involving the Cauchy based penalty function. Setting the system parameters by satisfying the proposed condition ensures convergence even though the overall cost function is non-convex when minimisation is performed via a proximal splitting algorithm. The proposed method based on Cauchy regularisation is evaluated by solving generic signal processing examples, i.e. 1D signal denoising in the frequency domain, two image reconstruction tasks including de-blurring and denoising, and error recovery in a multiple-antenna communication system. We experimentally verify the proposed convergence conditions for various cases, and show the effectiveness of the proposed Cauchy based non-convex penalty function over state-of-the-art penalty functions such as $L_1$ and total variation ($TV$) norms.

arXiv comment16 pages, 9 figures

References in corpus (10)

• BM3D Frames and Variational Image Deblurring
• Sparse Regularization via Convex Analysis
• Total Variation Denoising via the Moreau Envelope
• Uncertainty quantification for radio interferometric imaging: I. proximal MCMC methods
• Ship Wake Detection in SAR Images via Sparse Regularization
• Convex Denoising using Non-Convex Tight Frame Regularization
• On Solving SAR Imaging Inverse Problems Using Non-Convex Regularization with a Cauchy-based Penalty
• Detection of Line Artefacts in Lung Ultrasound Images of COVID-19 Patients via Non-Convex Regularization
• A Class of Nonconvex Penalties Preserving Overall Convexity in Optimization-Based Mean Filtering
• Image Fusion via Sparse Regularization with Non-Convex Penalties

Cited by in corpus (6)

• On Solving SAR Imaging Inverse Problems Using Non-Convex Regularization with a Cauchy-based Penalty
• Detection of Line Artefacts in Lung Ultrasound Images of COVID-19 Patients via Non-Convex Regularization
• Array SAR 3D Sparse Imaging Based on Regularization by Denoising Under Few Observed Data
• Representation Learning via Cauchy Convolutional Sparse Coding
• SAR Image Autofocusing using Wirtinger calculus and Cauchy regularization
• Exploiting the Dual-Tree Complex Wavelet Transform for Ship Wake Detection in SAR Imagery