Unpaired Deep Learning for Accelerated MRI using Optimal Transport Driven CycleGAN

Abstract

Recently, deep learning approaches for accelerated MRI have been extensively studied thanks to their high performance reconstruction in spite of significantly reduced runtime complexity. These neural networks are usually trained in a supervised manner, so matched pairs of subsampled and fully sampled k-space data are required. Unfortunately, it is often difficult to acquire matched fully sampled k-space data, since the acquisition of fully sampled k-space data requires long scan time and often leads to the change of the acquisition protocol. Therefore, unpaired deep learning without matched label data has become a very important research topic. In this paper, we propose an unpaired deep learning approach using a optimal transport driven cycle-consistent generative adversarial network (OT-cycleGAN) that employs a single pair of generator and discriminator. The proposed OT-cycleGAN architecture is rigorously derived from a dual formulation of the optimal transport formulation using a specially designed penalized least squares cost. The experimental results show that our method can reconstruct high resolution MR images from accelerated k- space data from both single and multiple coil acquisition, without requiring matched reference data.

Accepted for IEEE Transactions on Computational Imaging

References in corpus (8)

• Instance Normalization: The Missing Ingredient for Fast Stylization
• Image reconstruction by domain transform manifold learning
• Compressed Sensing MRI Reconstruction using a Generative Adversarial Network with a Cyclic Loss
• fastMRI: An Open Dataset and Benchmarks for Accelerated MRI
• Augmented CycleGAN: Learning Many-to-Many Mappings from Unpaired Data
• Cycle Consistent Adversarial Denoising Network for Multiphase Coronary CT Angiography
• Deep Generative Adversarial Networks for Compressed Sensing Automates MRI
• Optimal Transport driven CycleGAN for Unsupervised Learning in Inverse Problems