Neural Networks-based Regularization for Large-Scale Medical Image Reconstruction

Abstract

In this paper we present a generalized Deep Learning-based approach for solving ill-posed large-scale inverse problems occuring in medical image reconstruction. Recently, Deep Learning methods using iterative neural networks and cascaded neural networks have been reported to achieve state-of-the-art results with respect to various quantitative quality measures as PSNR, NRMSE and SSIM across different imaging modalities. However, the fact that these approaches employ the forward and adjoint operators repeatedly in the network architecture requires the network to process the whole images or volumes at once, which for some applications is computationally infeasible. In this work, we follow a different reconstruction strategy by decoupling the regularization of the solution from ensuring consistency with the measured data. The regularization is given in the form of an image prior obtained by the output of a previously trained neural network which is used in a Tikhonov regularization framework. By doing so, more complex and sophisticated network architectures can be used for the removal of the artefacts or noise than it is usually the case in iterative networks. Due to the large scale of the considered problems and the resulting computational complexity of the employed networks, the priors are obtained by processing the images or volumes as patches or slices. We evaluated the method for the cases of 3D cone-beam low dose CT and undersampled 2D radial cine MRI and compared it to a total variation-minimization-based reconstruction algorithm as well as to a method with regularization based on learned overcomplete dictionaries. The proposed method outperformed all the reported methods with respect to all chosen quantitative measures and further accelerates the regularization step in the reconstruction by several orders of magnitude.

References in corpus (17)

• Adam: A Method for Stochastic Optimization
• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Image reconstruction by domain transform manifold learning
• Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Loss
• MoDL: Model Based Deep Learning Architecture for Inverse Problems
• Learned Primal-dual Reconstruction
• Solving ill-posed inverse problems using iterative deep neural networks
• Can Deep Learning Outperform Modern Commercial CT Image Reconstruction Methods?
• Deep learning for undersampled MRI reconstruction
• GPU-based Low Dose CT Reconstruction via Edge-preserving Total Variation Regularization
• CNN-Based Projected Gradient Descent for Consistent Image Reconstruction
• Model based learning for accelerated, limited-view 3D photoacoustic tomography
• A Haar Wavelet-Based Perceptual Similarity Index for Image Quality Assessment
• Real-time Cardiovascular MR with Spatio-temporal Artifact Suppression using Deep Learning - Proof of Concept in Congenital Heart Disease
• Deep BCD-Net Using Identical Encoding-Decoding CNN Structures for Iterative Image Recovery
• Deep Null Space Learning for Inverse Problems: Convergence Analysis and Rates
• Spatio-Temporal Deep Learning-Based Undersampling Artefact Reduction for 2D Radial Cine MRI with Limited Data

Cited by in corpus (8)

• Learning to Optimize: A Primer and A Benchmark
• An End-To-End-Trainable Iterative Network Architecture for Accelerated Radial Multi-Coil 2D Cine MR Image Reconstruction
• Artifact Reduction in 3D and 4D Cone-beam Computed Tomography Images with Deep Learning -- A Review
• Deep, Deep Learning with BART
• Memory Efficient Model Based Deep Learning Reconstructions for High Spatial Resolution 3D Non-Cartesian Acquisitions
• Tailored 3D microphantoms: an essential tool for quantitative phase tomography analysis of organoids
• Deep learning based dictionary learning and tomographic image reconstruction
• Deep learning Based Correction Algorithms for 3D Medical Reconstruction in Computed Tomography and Macroscopic Imaging