CT Super-resolution GAN Constrained by the Identical, Residual, and Cycle Learning Ensemble(GAN-CIRCLE)

Abstract

Computed tomography (CT) is widely used in screening, diagnosis, and image-guided therapy for both clinical and research purposes. Since CT involves ionizing radiation, an overarching thrust of related technical research is development of novel methods enabling ultrahigh quality imaging with fine structural details while reducing the X-ray radiation. In this paper, we present a semi-supervised deep learning approach to accurately recover high-resolution (HR) CT images from low-resolution (LR) counterparts. Specifically, with the generative adversarial network (GAN) as the building block, we enforce the cycle-consistency in terms of the Wasserstein distance to establish a nonlinear end-to-end mapping from noisy LR input images to denoised and deblurred HR outputs. We also include the joint constraints in the loss function to facilitate structural preservation. In this deep imaging process, we incorporate deep convolutional neural network (CNN), residual learning, and network in network techniques for feature extraction and restoration. In contrast to the current trend of increasing network depth and complexity to boost the CT imaging performance, which limit its real-world applications by imposing considerable computational and memory overheads, we apply a parallel $1\times 1$ CNN to compress the output of the hidden layer and optimize the number of layers and the number of filters for each convolutional layer. Quantitative and qualitative evaluations demonstrate that our proposed model is accurate, efficient and robust for super-resolution (SR) image restoration from noisy LR input images. In particular, we validate our composite SR networks on three large-scale CT datasets, and obtain promising results as compared to the other state-of-the-art methods.

References in corpus (5)

• Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Loss
• Image Deblurring and Super-resolution by Adaptive Sparse Domain Selection and Adaptive Regularization
• Learned Primal-dual Reconstruction
• 3D Convolutional Encoder-Decoder Network for Low-Dose CT via Transfer Learning from a 2D Trained Network
• Structure-sensitive Multi-scale Deep Neural Network for Low-Dose CT Denoising

Cited by in corpus (21)

• MRI Super-Resolution with Ensemble Learning and Complementary Priors
• PhaseGAN: A deep-learning phase-retrieval approach for unpaired datasets
• Data synthesis and adversarial networks: A review and meta-analysis in cancer imaging
• Deep Learning Methods for Solving Linear Inverse Problems: Research Directions and Paradigms
• Convolutional Neural Networks with Intermediate Loss for 3D Super-Resolution of CT and MRI Scans
• VolumeNet: A Lightweight Parallel Network for Super-Resolution of Medical Volumetric Data
• LIT-Former: Linking In-plane and Through-plane Transformers for Simultaneous CT Image Denoising and Deblurring
• Three-dimensional Generative Adversarial Nets for Unsupervised Metal Artifact Reduction
• Evaluating the Clinical Realism of Synthetic Chest X-Rays Generated Using Progressively Growing GANs
• Dehazing Ultrasound using Diffusion Models
• Hypernetwork-based Personalized Federated Learning for Multi-Institutional CT Imaging
• Systematic Review on Learning-based Spectral CT
• An Unsupervised Reconstruction Method For Low-Dose CT Using Deep Generative Regularization Prior
• Increasing a microscope's effective field of view via overlapped imaging and machine learning
• Machine-Learning-Assisted Photonic Device Development: A Multiscale Approach from Theory to Characterization
• I${}^3$Net: Inter-Intra-slice Interpolation Network for Medical Slice Synthesis
• PET-enabled Dual-Energy CT: Image Reconstruction and A Proof-of-Concept Computer Simulation Study
• Survey on Visual Signal Coding and Processing with Generative Models: Technologies, Standards and Optimization
• Cross-Vendor CT Image Data Harmonization Using CVH-CT
• Systematic Review and Meta-analysis of AI-driven MRI Motion Artifact Detection and Correction
• Reliable Multi-modal Medical Image-to-image Translation Independent of Pixel-wise Aligned Data