On the Contractivity of Plug-and-Play Operators

Abstract

In plug-and-play (PnP) regularization, the proximal operator in algorithms such as ISTA and ADMM is replaced by a powerful denoiser. This formal substitution works surprisingly well in practice. In fact, PnP has been shown to give state-of-the-art results for various imaging applications. The empirical success of PnP has motivated researchers to understand its theoretical underpinnings and, in particular, its convergence. It was shown in prior work that for kernel denoisers such as the nonlocal means, PnP-ISTA provably converges under some strong assumptions on the forward model. The present work is motivated by the following questions: Can we relax the assumptions on the forward model? Can the convergence analysis be extended to PnP-ADMM? Can we estimate the convergence rate? In this letter, we resolve these questions using the contraction mapping theorem: (i) for symmetric denoisers, we show that (under mild conditions) PnP-ISTA and PnP-ADMM exhibit linear convergence; and (ii) for kernel denoisers, we show that PnP-ISTA and PnP-ADMM converge linearly for image inpainting. We validate our theoretical findings using reconstruction experiments.

arXiv commentErrors in the proof of Lemma 1 and the statement of Theorem 2 were identified after the publication; these have been rectified in the revised version (v2)

References in corpus (11)

• Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Denoising Prior Driven Deep Neural Network for Image Restoration
• Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation
• Plug and play methods for magnetic resonance imaging (long version)
• Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imaging
• Provable Convergence of Plug-and-Play Priors with MMSE denoisers
• Fixed-Point and Objective Convergence of Plug-and-Play Algorithms
• Plug-and-play ISTA converges with kernel denoisers
• On Plug-and-Play Regularization using Linear Denoisers
• Plug-and-Play Regularization using Linear Solvers

Cited by in corpus (1)

• On the Strong Convexity of PnP Regularization Using Linear Denoisers