Image Reconstruction: From Sparsity to Data-adaptive Methods and Machine Learning

Abstract

The field of medical image reconstruction has seen roughly four types of methods. The first type tended to be analytical methods, such as filtered back-projection (FBP) for X-ray computed tomography (CT) and the inverse Fourier transform for magnetic resonance imaging (MRI), based on simple mathematical models for the imaging systems. These methods are typically fast, but have suboptimal properties such as poor resolution-noise trade-off for CT. A second type is iterative reconstruction methods based on more complete models for the imaging system physics and, where appropriate, models for the sensor statistics. These iterative methods improved image quality by reducing noise and artifacts. The FDA-approved methods among these have been based on relatively simple regularization models. A third type of methods has been designed to accommodate modified data acquisition methods, such as reduced sampling in MRI and CT to reduce scan time or radiation dose. These methods typically involve mathematical image models involving assumptions such as sparsity or low-rank. A fourth type of methods replaces mathematically designed models of signals and systems with data-driven or adaptive models inspired by the field of machine learning. This paper focuses on the two most recent trends in medical image reconstruction: methods based on sparsity or low-rank models, and data-driven methods based on machine learning techniques.

To appear in the Proceedings of the IEEE, Special Issue on Biomedical Imaging and Analysis in the Age of Sparsity, Big Data, and Deep Learning

References in corpus (27)

• Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising
• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN)
• Image reconstruction by domain transform manifold learning
• Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Loss
• The Convex Geometry of Linear Inverse Problems
• Learned Primal-dual Reconstruction
• A deep convolutional neural network using directional wavelets for low-dose X-ray CT reconstruction
• Deep Learning Microscopy
• Deep-STORM: super-resolution single-molecule microscopy by deep learning
• Compressed Sensing MRI Reconstruction using a Generative Adversarial Network with a Cyclic Loss
• Can Deep Learning Outperform Modern Commercial CT Image Reconstruction Methods?
• Deep-neural-network based sinogram synthesis for sparse-view CT image reconstruction
• Cycle Consistent Adversarial Denoising Network for Multiphase Coronary CT Angiography
• Convolutional Dictionary Learning: A Comparative Review and New Algorithms
• Subspace Learning and Imputation for Streaming Big Data Matrices and Tensors
• Bayesian Nonparametric Dictionary Learning for Compressed Sensing MRI
• An Online Algorithm for Separating Sparse and Low-dimensional Signal Sequences from their Sum
• Convolutional Dictionary Learning: Acceleration and Convergence
• Deep BCD-Net Using Identical Encoding-Decoding CNN Structures for Iterative Image Recovery
• PWLS-ULTRA: An Efficient Clustering and Learning-Based Approach for Low-Dose 3D CT Image Reconstruction
• Low Rank Magnetic Resonance Fingerprinting
• Low-rank and Adaptive Sparse Signal (LASSI) Models for Highly Accelerated Dynamic Imaging
• Data-Driven Learning of a Union of Sparsifying Transforms Model for Blind Compressed Sensing
• Efficient Sum of Outer Products Dictionary Learning (SOUP-DIL) and Its Application to Inverse Problems
• Convex recovery of continuous domain piecewise constant images from non-uniform Fourier samples
• Learning Filter Bank Sparsifying Transforms

Cited by in corpus (24)

• AMP-Net: Denoising based Deep Unfolding for Compressive Image Sensing
• Content-aware Scalable Deep Compressed Sensing
• A Cone-Beam X-Ray CT Data Collection designed for Machine Learning
• xQSM: Quantitative Susceptibility Mapping with Octave Convolutional and Noise Regularized Neural Networks
• Accelerating Quantitative Susceptibility Mapping using Compressed Sensing and Deep Neural Network
• Compressible Latent-Space Invertible Networks for Generative Model-Constrained Image Reconstruction
• 2DeteCT -- A large 2D expandable, trainable, experimental Computed Tomography dataset for machine learning
• High-Precision Inversion of Dynamic Radiography Using Hydrodynamic Features
• Single-pass Object-adaptive Data Undersampling and Reconstruction for MRI
• Local Models for Scatter Estimation and Descattering in Polyenergetic X-Ray Tomography
• NESTANets: Stable, accurate and efficient neural networks for analysis-sparse inverse problems
• A Tutorial on MRI Reconstruction: From Modern Methods to Clinical Implications
• Motion-robust free-running volumetric cardiovascular MRI
• Advances in Photoacoustic Imaging Reconstruction and Quantitative Analysis for Biomedical Applications
• A Fast and Scalable Polyatomic Frank-Wolfe Algorithm for the LASSO
• Multi-Channel Convolutional Analysis Operator Learning for Dual-Energy CT Reconstruction
• Learning Robust Features for Scatter Removal and Reconstruction in Dynamic ICF X-Ray Tomography
• Adaptive Local Neighborhood-based Neural Networks for MR Image Reconstruction from Undersampled Data
• MRI Recovery with Self-Calibrated Denoisers without Fully-Sampled Data
• Deep Image prior with StruCtUred Sparsity (DISCUS) for dynamic MRI reconstruction
• Deep learning based dictionary learning and tomographic image reconstruction
• Visibility Interpolation in Solar Hard X-ray Imaging: Application to RHESSI and STIX
• Swap-Net: A Memory-Efficient 2.5D Network for Sparse-View 3D Cone Beam CT Reconstruction
• Patient-Adaptive and Learned MRI Data Undersampling Using Neighborhood Clustering