Bayesian Image Super-Resolution with Deep Modeling of Image Statistics

Abstract

Modeling statistics of image priors is useful for image super-resolution, but little attention has been paid from the massive works of deep learning-based methods. In this work, we propose a Bayesian image restoration framework, where natural image statistics are modeled with the combination of smoothness and sparsity priors. Concretely, firstly we consider an ideal image as the sum of a smoothness component and a sparsity residual, and model real image degradation including blurring, downscaling, and noise corruption. Then, we develop a variational Bayesian approach to infer their posteriors. Finally, we implement the variational approach for single image super-resolution (SISR) using deep neural networks, and propose an unsupervised training strategy. The experiments on three image restoration tasks, \textit{i.e.,} ideal SISR, realistic SISR, and real-world SISR, demonstrate that our method has superior model generalizability against varying noise levels and degradation kernels and is effective in unsupervised SISR. The code and resulting models are released via \url{https://zmiclab.github.io/projects.html}.

arXiv comment45 pages

References in corpus (8)

• Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
• FFDNet: Toward a Fast and Flexible Solution for CNN based Image Denoising
• An Introduction to Variational Autoencoders
• Noise2Noise: Learning Image Restoration without Clean Data
• Denoising Prior Driven Deep Neural Network for Image Restoration
• Wide Activation for Efficient and Accurate Image Super-Resolution
• Variational Denoising Network: Toward Blind Noise Modeling and Removal
• Blind Universal Bayesian Image Denoising with Gaussian Noise Level Learning

Cited by in corpus (4)

• A Generalized Tensor Formulation for Hyperspectral Image Super-Resolution Under General Spatial Blurring
• Variational Bayes image restoration with compressive autoencoders
• A Single-Frame and Multi-Frame Cascaded Image Super-Resolution Method
• Deep priors for satellite image restoration with accurate uncertainties