An Adversarial Learning Based Approach for Unknown View Tomographic Reconstruction

Abstract

The goal of 2D tomographic reconstruction is to recover an image given its projections from various views. It is often presumed that projection angles associated with the projections are known in advance. Under certain situations, however, these angles are known only approximately or are completely unknown. It becomes more challenging to reconstruct the image from a collection of random projections. We propose an adversarial learning based approach to recover the image and the projection angle distribution by matching the empirical distribution of the measurements with the generated data. Fitting the distributions is achieved through solving a min-max game between a generator and a critic based on Wasserstein generative adversarial network structure. To accommodate the update of the projection angle distribution through gradient back propagation, we approximate the loss using the Gumbel-Softmax reparameterization of samples from discrete distributions. Our theoretical analysis verifies the unique recovery of the image and the projection distribution up to a rotation and reflection upon convergence. Our extensive numerical experiments showcase the potential of our method to accurately recover the image and the projection angle distribution under noise contamination.

References in corpus (12)

• Spectral Normalization for Generative Adversarial Networks
• Categorical Reparameterization with Gumbel-Softmax
• Deep Convolutional Neural Network for Inverse Problems in Imaging
• Empirical Evaluation of Rectified Activations in Convolutional Network
• Low-Dose CT with a Residual Encoder-Decoder Convolutional Neural Network (RED-CNN)
• Image reconstruction by domain transform manifold learning
• Low Dose CT Image Denoising Using a Generative Adversarial Network with Wasserstein Distance and Perceptual Loss
• Compressed Sensing MRI Reconstruction using a Generative Adversarial Network with a Cyclic Loss
• Can Deep Learning Outperform Modern Commercial CT Image Reconstruction Methods?
• A Deep Learning Reconstruction Framework for Differential Phase-Contrast Computed Tomography with Incomplete Data
• Fourier-Bessel rotational invariant eigenimages
• A Fourier-based Approach for Iterative 3D Reconstruction from Cryo-EM Images