Discriminative Cross-Modal Data Augmentation for Medical Imaging Applications

Abstract

While deep learning methods have shown great success in medical image analysis, they require a number of medical images to train. Due to data privacy concerns and unavailability of medical annotators, it is oftentimes very difficult to obtain a lot of labeled medical images for model training. In this paper, we study cross-modality data augmentation to mitigate the data deficiency issue in the medical imaging domain. We propose a discriminative unpaired image-to-image translation model which translates images in source modality into images in target modality where the translation task is conducted jointly with the downstream prediction task and the translation is guided by the prediction. Experiments on two applications demonstrate the effectiveness of our method.

References in corpus (15)

• Adam: A Method for Stochastic Optimization
• Conditional Generative Adversarial Nets
• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
• Large Scale GAN Training for High Fidelity Natural Image Synthesis
• The Effectiveness of Data Augmentation in Image Classification using Deep Learning
• Conditional Image Synthesis With Auxiliary Classifier GANs
• GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification
• Progressive Growing of GANs for Improved Quality, Stability, and Variation
• AutoAugment: Learning Augmentation Policies from Data
• Data Augmentation using Random Image Cropping and Patching for Deep CNNs
• Synthetic Medical Images from Dual Generative Adversarial Networks
• Differentiable Augmentation for Data-Efficient GAN Training
• Learning Data Augmentation for Brain Tumor Segmentation with Coarse-to-Fine Generative Adversarial Networks
• DM-GAN: Dynamic Memory Generative Adversarial Networks for Text-to-Image Synthesis