Unified Supervised-Unsupervised (SUPER) Learning for X-ray CT Image Reconstruction

Abstract

Traditional model-based image reconstruction (MBIR) methods combine forward and noise models with simple object priors. Recent machine learning methods for image reconstruction typically involve supervised learning or unsupervised learning, both of which have their advantages and disadvantages. In this work, we propose a unified supervised-unsupervised (SUPER) learning framework for X-ray computed tomography (CT) image reconstruction. The proposed learning formulation combines both unsupervised learning-based priors (or even simple analytical priors) together with (supervised) deep network-based priors in a unified MBIR framework based on a fixed point iteration analysis. The proposed training algorithm is also an approximate scheme for a bilevel supervised training optimization problem, wherein the network-based regularizer in the lower-level MBIR problem is optimized using an upper-level reconstruction loss. The training problem is optimized by alternating between updating the network weights and iteratively updating the reconstructions based on those weights. We demonstrate the learned SUPER models' efficacy for low-dose CT image reconstruction, for which we use the NIH AAPM Mayo Clinic Low Dose CT Grand Challenge dataset for training and testing. In our experiments, we studied different combinations of supervised deep network priors and unsupervised learning-based or analytical priors. Both numerical and visual results show the superiority of the proposed unified SUPER methods over standalone supervised learning-based methods, iterative MBIR methods, and variations of SUPER obtained via ablation studies. We also show that the proposed algorithm converges rapidly in practice.

arXiv comment18 pages, 21 figures, submitted journal paper

References in corpus (18)

• Adam: A Method for Stochastic Optimization
• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN)
• MoDL: Model Based Deep Learning Architecture for Inverse Problems
• Learned Primal-dual Reconstruction
• Solving ill-posed inverse problems using iterative deep neural networks
• Can Deep Learning Outperform Modern Commercial CT Image Reconstruction Methods?
• Cycle Consistent Adversarial Denoising Network for Multiphase Coronary CT Angiography
• Computed Tomography Reconstruction Using Deep Image Prior and Learned Reconstruction Methods
• Deep Generative Adversarial Networks for Compressed Sensing Automates MRI
• Deep BCD-Net Using Identical Encoding-Decoding CNN Structures for Iterative Image Recovery
• PWLS-ULTRA: An Efficient Clustering and Learning-Based Approach for Low-Dose 3D CT Image Reconstruction
• Data-Driven Learning of a Union of Sparsifying Transforms Model for Blind Compressed Sensing
• Relaxed Linearized Algorithms for Faster X-Ray CT Image Reconstruction
• Recurrent Generative Adversarial Networks for Proximal Learning and Automated Compressive Image Recovery
• Learning Filter Bank Sparsifying Transforms
• SPULTRA: Low-Dose CT Image Reconstruction with Joint Statistical and Learned Image Models
• Supervised Learning of Sparsity-Promoting Regularizers for Denoising

Cited by in corpus (4)

• Physics-/Model-Based and Data-Driven Methods for Low-Dose Computed Tomography: A survey
• Single-pass Object-adaptive Data Undersampling and Reconstruction for MRI
• Cross-domain Denoising for Low-dose Multi-frame Spiral Computed Tomography
• Adaptive Local Neighborhood-based Neural Networks for MR Image Reconstruction from Undersampled Data