Adversarial Transformations for Semi-Supervised Learning

Abstract

We propose a Regularization framework based on Adversarial Transformations (RAT) for semi-supervised learning. RAT is designed to enhance robustness of the output distribution of class prediction for a given data against input perturbation. RAT is an extension of Virtual Adversarial Training (VAT) in such a way that RAT adversarialy transforms data along the underlying data distribution by a rich set of data transformation functions that leave class label invariant, whereas VAT simply produces adversarial additive noises. In addition, we verified that a technique of gradually increasing of perturbation region further improve the robustness. In experiments, we show that RAT significantly improves classification performance on CIFAR-10 and SVHN compared to existing regularization methods under standard semi-supervised image classification settings.

Accepted by AAAI 2020

References in corpus (13)

• Adam: A Method for Stochastic Optimization
• Explaining and Harnessing Adversarial Examples
• mixup: Beyond Empirical Risk Minimization
• Wide Residual Networks
• Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results
• Improved Techniques for Training GANs
• Interpolation Consistency Training for Semi-Supervised Learning
• MixMatch: A Holistic Approach to Semi-Supervised Learning
• Regularization With Stochastic Transformations and Perturbations for Deep Semi-Supervised Learning
• Realistic Evaluation of Deep Semi-Supervised Learning Algorithms
• Adversarial Training Methods for Semi-Supervised Text Classification
• Semi-supervised Learning with GANs: Manifold Invariance with Improved Inference
• ADef: an Iterative Algorithm to Construct Adversarial Deformations