Learning The Invisible: A Hybrid Deep Learning-Shearlet Framework for Limited Angle Computed Tomography

Abstract

The high complexity of various inverse problems poses a significant challenge to model-based reconstruction schemes, which in such situations often reach their limits. At the same time, we witness an exceptional success of data-based methodologies such as deep learning. However, in the context of inverse problems, deep neural networks mostly act as black box routines, used for instance for a somewhat unspecified removal of artifacts in classical image reconstructions. In this paper, we will focus on the severely ill-posed inverse problem of limited angle computed tomography, in which entire boundary sections are not captured in the measurements. We will develop a hybrid reconstruction framework that fuses model-based sparse regularization with data-driven deep learning. Our method is reliable in the sense that we only learn the part that can provably not be handled by model-based methods, while applying the theoretically controllable sparse regularization technique to the remaining parts. Such a decomposition into visible and invisible segments is achieved by means of the shearlet transform that allows to resolve wavefront sets in the phase space. Furthermore, this split enables us to assign the clear task of inferring unknown shearlet coefficients to the neural network and thereby offering an interpretation of its performance in the context of limited angle computed tomography. Our numerical experiments show that our algorithm significantly surpasses both pure model- and more data-based reconstruction methods.

References in corpus (13)

• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Learned Primal-dual Reconstruction
• A Review of Convolutional Neural Networks for Inverse Problems in Imaging
• Solving ill-posed inverse problems using iterative deep neural networks
• Model based learning for accelerated, limited-view 3D photoacoustic tomography
• A Haar Wavelet-Based Perceptual Similarity Index for Image Quality Assessment
• Learning Proximal Operators: Using Denoising Networks for Regularizing Inverse Imaging Problems
• Tomographic inversion using ${\ell }_1$-norm regularization of wavelet coefficients
• Deep Null Space Learning for Inverse Problems: Convergence Analysis and Rates
• How little data is enough? Phase-diagram analysis of sparsity-regularized X-ray CT
• Indirect Image Registration with Large Diffeomorphic Deformations
• How Strong Are Streak Artifacts in Limited Angle Computed Tomography?
• Regularization of Inverse Problems via Time Discrete Geodesics in Image Spaces

Cited by in corpus (10)

• Computed Tomography Reconstruction Using Deep Image Prior and Learned Reconstruction Methods
• Solving Inverse Problems With Deep Neural Networks -- Robustness Included?
• Limitations of Deep Learning for Inverse Problems on Digital Hardware
• A data-driven iteratively regularized Landweber iteration
• Data driven regularization by projection
• Big in Japan: Regularizing networks for solving inverse problems
• Physics-assisted Generative Adversarial Network for X-Ray Tomography
• A joint reconstruction and lambda tomography regularization technique for energy-resolved X-ray imaging
• Efficient representation of spatio-temporal data using cylindrical shearlets
• On the randomised stability constant for inverse problems