Semi-supervised Learning using Adversarial Training with Good and Bad Samples

Abstract

In this work, we investigate semi-supervised learning (SSL) for image classification using adversarial training. Previous results have illustrated that generative adversarial networks (GANs) can be used for multiple purposes. Triple-GAN, which aims to jointly optimize model components by incorporating three players, generates suitable image-label pairs to compensate for the lack of labeled data in SSL with improved benchmark performance. Conversely, Bad (or complementary) GAN, optimizes generation to produce complementary data-label pairs and force a classifier's decision boundary to lie between data manifolds. Although it generally outperforms Triple-GAN, Bad GAN is highly sensitive to the amount of labeled data used for training. Unifying these two approaches, we present unified-GAN (UGAN), a novel framework that enables a classifier to simultaneously learn from both good and bad samples through adversarial training. We perform extensive experiments on various datasets and demonstrate that UGAN: 1) achieves state-of-the-art performance among other deep generative models, and 2) is robust to variations in the amount of labeled data used for training.

References in corpus (17)

• Adam: A Method for Stochastic Optimization
• Conditional Generative Adversarial Nets
• Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks
• Large Scale GAN Training for High Fidelity Natural Image Synthesis
• Spectral Normalization for Generative Adversarial Networks
• Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results
• Temporal Ensembling for Semi-Supervised Learning
• YouTube-8M: A Large-Scale Video Classification Benchmark
• Adversarially Learned Inference
• Semi-Supervised Learning with Ladder Networks
• Variational Autoencoder for Deep Learning of Images, Labels and Captions
• Unsupervised and Semi-supervised Learning with Categorical Generative Adversarial Networks
• Triple Generative Adversarial Nets
• High-Fidelity Image Generation With Fewer Labels
• Semi-supervised Rare Disease Detection Using Generative Adversarial Network
• Semi-supervised learning based on generative adversarial network: a comparison between good GAN and bad GAN approach
• Semi-Supervised Learning with GANs: Revisiting Manifold Regularization