Selective Synthetic Augmentation with Quality Assurance
arXiv:1912.03837
Abstract
Supervised training of an automated medical image analysis system often requires a large amount of expert annotations that are hard to collect. Moreover, the proportions of data available across different classes may be highly imbalanced for rare diseases. To mitigate these issues, we investigate a novel data augmentation pipeline that selectively adds new synthetic images generated by conditional Adversarial Networks (cGANs), rather than extending directly the training set with synthetic images. The selection mechanisms that we introduce to the synthetic augmentation pipeline are motivated by the observation that, although cGAN-generated images can be visually appealing, they are not guaranteed to contain essential features for classification performance improvement. By selecting synthetic images based on the confidence of their assigned labels and their feature similarity to real labeled images, our framework provides quality assurance to synthetic augmentation by ensuring that adding the selected synthetic images to the training set will improve performance. We evaluate our model on a medical histopathology dataset, and two natural image classification benchmarks, CIFAR10 and SVHN. Results on these datasets show significant and consistent improvements in classification performance (with 6.8%, 3.9%, 1.6% higher accuracy, respectively) by leveraging cGAN generated images with selective augmentation.
References in corpus (14)
- Conditional Generative Adversarial Nets
- GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium
- Large Scale GAN Training for High Fidelity Natural Image Synthesis
- Spectral Normalization for Generative Adversarial Networks
- Self-Attention Generative Adversarial Networks
- The Effectiveness of Data Augmentation in Image Classification using Deep Learning
- Conditional Image Synthesis With Auxiliary Classifier GANs
- GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification
- Progressive Growing of GANs for Improved Quality, Stability, and Variation
- Data Augmentation Generative Adversarial Networks
- GAN Augmentation: Augmenting Training Data using Generative Adversarial Networks
- BAGAN: Data Augmentation with Balancing GAN
- Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules
- Image Generation From Small Datasets via Batch Statistics Adaptation