Fast Scalable Image Restoration using Total Variation Priors and Expectation Propagation

Abstract

This paper presents a scalable approximate Bayesian method for image restoration using total variation (TV) priors. In contrast to most optimization methods based on maximum a posteriori estimation, we use the expectation propagation (EP) framework to approximate minimum mean squared error (MMSE) estimators and marginal (pixel-wise) variances, without resorting to Monte Carlo sampling. For the classical anisotropic TV-based prior, we also propose an iterative scheme to automatically adjust the regularization parameter via expectation-maximization (EM). Using Gaussian approximating densities with diagonal covariance matrices, the resulting method allows highly parallelizable steps and can scale to large images for denoising, deconvolution and compressive sensing (CS) problems. The simulation results illustrate that such EP methods can provide a posteriori estimates on par with those obtained via sampling methods but at a fraction of the computational cost. Moreover, EP does not exhibit strong underestimation of posteriori variances, in contrast to variational Bayes alternatives.

arXiv comment14 pages

References in corpus (10)

• Variational Inference: A Review for Statisticians
• Fast Image Recovery Using Variable Splitting and Constrained Optimization
• Expectation propagation as a way of life: A framework for Bayesian inference on partitioned data
• LIDIA: Lightweight Learned Image Denoising with Instance Adaptation
• Expectation Propagation for Nonlinear Inverse Problems -- with an Application to Electrical Impedance Tomography
• Asymptotically exact data augmentation: models, properties and algorithms
• Compressed sensing reconstruction using Expectation Propagation
• External Patch-Based Image Restoration Using Importance Sampling
• Accelerating proximal Markov chain Monte Carlo by using an explicit stabilised method
• Non-convex image reconstruction via Expectation Propagation