Synthetic Medical Images from Dual Generative Adversarial Networks

Abstract

Currently there is strong interest in data-driven approaches to medical image classification. However, medical imaging data is scarce, expensive, and fraught with legal concerns regarding patient privacy. Typical consent forms only allow for patient data to be used in medical journals or education, meaning the majority of medical data is inaccessible for general public research. We propose a novel, two-stage pipeline for generating synthetic medical images from a pair of generative adversarial networks, tested in practice on retinal fundi images. We develop a hierarchical generation process to divide the complex image generation task into two parts: geometry and photorealism. We hope researchers will use our pipeline to bring private medical data into the public domain, sparking growth in imaging tasks that have previously relied on the hand-tuning of models. We have begun this initiative through the development of SynthMed, an online repository for synthetic medical images.

arXiv commentFirst two authors contributed equally. Accepted to NIPS 2017 Workshops on Medical Imaging and Machine Learning for Health

References in corpus (1)

• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks

Cited by in corpus (27)

• Generative Adversarial Network in Medical Imaging: A Review
• Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation
• Using GANs for Sharing Networked Time Series Data: Challenges, Initial Promise, and Open Questions
• Free-form tumor synthesis in computed tomography images via richer generative adversarial network
• DC-AL GAN: Pseudoprogression and True Tumor Progression of Glioblastoma Multiform Image Classification Based on DCGAN and AlexNet
• Generative adversarial networks in time series: A survey and taxonomy
• Conditional Generation of Medical Images via Disentangled Adversarial Inference
• Synthesis of Realistic ECG using Generative Adversarial Networks
• Towards generative adversarial networks as a new paradigm for radiology education
• General Purpose (GenP) Bioimage Ensemble of Handcrafted and Learned Features with Data Augmentation
• Conditional Infilling GANs for Data Augmentation in Mammogram Classification
• Imperfect ImaGANation: Implications of GANs Exacerbating Biases on Facial Data Augmentation and Snapchat Selfie Lenses
• Unsupervised Medical Image Segmentation with Adversarial Networks: From Edge Diagrams to Segmentation Maps
• General-to-Detailed GAN for Infrequent Class Medical Images
• Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesis
• Synthesizing brain tumor images and annotations by combining progressive growing GAN and SPADE
• Capturing Variabilities from Computed Tomography Images with Generative Adversarial Networks
• Ebola Optimization Search Algorithm (EOSA): A new metaheuristic algorithm based on the propagation model of Ebola virus disease
• TricycleGAN: Unsupervised Image Synthesis and Segmentation Based on Shape Priors
• Ensembles of GANs for synthetic training data generation
• Semi-supervised mp-MRI Data Synthesis with StitchLayer and Auxiliary Distance Maximization
• G2R Bound: A Generalization Bound for Supervised Learning from GAN-Synthetic Data
• Discriminative Cross-Modal Data Augmentation for Medical Imaging Applications
• Multimodal Medical Volume Colorization from 2D Style
• Anonymization of labeled TOF-MRA images for brain vessel segmentation using generative adversarial networks
• Synthesizing New Retinal Symptom Images by Multiple Generative Models
• Downhole Track Detection via Multiscale Conditional Generative Adversarial Nets