Generative Adversarial Networks for Image-to-Image Translation on Multi-Contrast MR Images - A Comparison of CycleGAN and UNIT

Abstract

In medical imaging, a general problem is that it is costly and time consuming to collect high quality data from healthy and diseased subjects. Generative adversarial networks (GANs) is a deep learning method that has been developed for synthesizing data. GANs can thereby be used to generate more realistic training data, to improve classification performance of machine learning algorithms. Another application of GANs is image-to-image translations, e.g. generating magnetic resonance (MR) images from computed tomography (CT) images, which can be used to obtain multimodal datasets from a single modality. Here, we evaluate two unsupervised GAN models (CycleGAN and UNIT) for image-to-image translation of T1- and T2-weighted MR images, by comparing generated synthetic MR images to ground truth images. We also evaluate two supervised models; a modification of CycleGAN and a pure generator model. A small perceptual study was also performed to evaluate how visually realistic the synthesized images are. It is shown that the implemented GAN models can synthesize visually realistic MR images (incorrectly labeled as real by a human). It is also shown that models producing more visually realistic synthetic images not necessarily have better quantitative error measurements, when compared to ground truth data. Code is available at https://github.com/simontomaskarlsson/GAN-MRI

References in corpus (1)

• Data Augmentation Generative Adversarial Networks

Cited by in corpus (14)

• Generative Adversarial Network in Medical Imaging: A Review
• Unsupervised Medical Image Translation Using Cycle-MedGAN
• Artificial Intelligence in Glioma Imaging: Challenges and Advances
• Refacing: reconstructing anonymized facial features using GANs
• Generation of microbial colonies dataset with deep learning style transfer
• IGUANe: a 3D generalizable CycleGAN for multicenter harmonization of brain MR images
• Bridging the gap between paired and unpaired medical image translation
• Generating fMRI volumes from T1-weighted volumes using 3D CycleGAN
• Overview of image-to-image translation by use of deep neural networks: denoising, super-resolution, modality conversion, and reconstruction in medical imaging
• Which Contrast Does Matter? Towards a Deep Understanding of MR Contrast using Collaborative GAN
• DiamondGAN: Unified Multi-Modal Generative Adversarial Networks for MRI Sequences Synthesis
• Steganography GAN: Cracking Steganography with Cycle Generative Adversarial Networks
• Micro-CT Synthesis and Inner Ear Super Resolution via Generative Adversarial Networks and Bayesian Inference
• Flow-based Deformation Guidance for Unpaired Multi-Contrast MRI Image-to-Image Translation