KeepAugment: A Simple Information-Preserving Data Augmentation Approach

Abstract

Data augmentation (DA) is an essential technique for training state-of-the-art deep learning systems. In this paper, we empirically show data augmentation might introduce noisy augmented examples and consequently hurt the performance on unaugmented data during inference. To alleviate this issue, we propose a simple yet highly effective approach, dubbed \emph{KeepAugment}, to increase augmented images fidelity. The idea is first to use the saliency map to detect important regions on the original images and then preserve these informative regions during augmentation. This information-preserving strategy allows us to generate more faithful training examples. Empirically, we demonstrate our method significantly improves on a number of prior art data augmentation schemes, e.g. AutoAugment, Cutout, random erasing, achieving promising results on image classification, semi-supervised image classification, multi-view multi-camera tracking and object detection.

References in corpus (15)

• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• Improved Regularization of Convolutional Neural Networks with Cutout
• FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidence
• Unsupervised Data Augmentation for Consistency Training
• Random Erasing Data Augmentation
• AutoAugment: Learning Augmentation Policies from Data
• DropBlock: A regularization method for convolutional networks
• Shake-Shake regularization
• GridMask Data Augmentation
• Improved Noisy Student Training for Automatic Speech Recognition
• ShakeDrop Regularization for Deep Residual Learning
• Adversarial AutoAugment
• Affinity and Diversity: Quantifying Mechanisms of Data Augmentation
• MaxUp: A Simple Way to Improve Generalization of Neural Network Training
• Circumventing Outliers of AutoAugment with Knowledge Distillation