MelanoGANs: High Resolution Skin Lesion Synthesis with GANs

Abstract

Generative Adversarial Networks (GANs) have been successfully used to synthesize realistically looking images of faces, scenery and even medical images. Unfortunately, they usually require large training datasets, which are often scarce in the medical field, and to the best of our knowledge GANs have been only applied for medical image synthesis at fairly low resolution. However, many state-of-the-art machine learning models operate on high resolution data as such data carries indispensable, valuable information. In this work, we try to generate realistically looking high resolution images of skin lesions with GANs, using only a small training dataset of 2000 samples. The nature of the data allows us to do a direct comparison between the image statistics of the generated samples and the real dataset. We both quantitatively and qualitatively compare state-of-the-art GAN architectures such as DCGAN and LAPGAN against a modification of the latter for the task of image generation at a resolution of 256x256px. Our investigation shows that we can approximate the real data distribution with all of the models, but we notice major differences when visually rating sample realism, diversity and artifacts. In a set of use-case experiments on skin lesion classification, we further show that we can successfully tackle the problem of heavy class imbalance with the help of synthesized high resolution melanoma samples.

References in corpus (4)

• Conditional Generative Adversarial Nets
• Progressive Growing of GANs for Improved Quality, Stability, and Variation
• Data Augmentation Generative Adversarial Networks
• Image Classification of Melanoma, Nevus and Seborrheic Keratosis by Deep Neural Network Ensemble

Cited by in corpus (10)

• Generative Adversarial Network in Medical Imaging: A Review
• CT-GAN: Malicious Tampering of 3D Medical Imagery using Deep Learning
• Assessment of Generative Adversarial Networks Model for Synthetic Optical Coherence Tomography Images of Retinal Disorders
• DermGAN: Synthetic Generation of Clinical Skin Images with Pathology
• Medical Image Generation using Generative Adversarial Networks
• Imagining an Engineer: On GAN-Based Data Augmentation Perpetuating Biases
• Skin disease diagnosis with deep learning: a review
• ScarGAN: Chained Generative Adversarial Networks to Simulate Pathological Tissue on Cardiovascular MR Scans
• Augmentation Inside the Network
• Parallel Medical Imaging for Intelligent Medical Image Analysis: Concepts, Methods, and Applications