Cut-Thumbnail: A Novel Data Augmentation for Convolutional Neural Network

Abstract

In this paper, we propose a novel data augmentation strategy named Cut-Thumbnail, that aims to improve the shape bias of the network. We reduce an image to a certain size and replace the random region of the original image with the reduced image. The generated image not only retains most of the original image information but also has global information in the reduced image. We call the reduced image as thumbnail. Furthermore, we find that the idea of thumbnail can be perfectly integrated with Mixed Sample Data Augmentation, so we put one image's thumbnail on another image while the ground truth labels are also mixed, making great achievements on various computer vision tasks. Extensive experiments show that Cut-Thumbnail works better than state-of-the-art augmentation strategies across classification, fine-grained image classification, and object detection. On ImageNet classification, ResNet-50 architecture with our method achieves 79.21\% accuracy, which is more than 2.8\% improvement on the baseline.

arXiv commentAccepted at ACM MM 2021

References in corpus (11)

• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
• Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
• mixup: Beyond Empirical Risk Minimization
• Fully Convolutional Networks for Semantic Segmentation
• Improved Regularization of Convolutional Neural Networks with Cutout
• FractalNet: Ultra-Deep Neural Networks without Residuals
• CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features
• DropBlock: A regularization method for convolutional networks
• GridMask Data Augmentation
• FMix: Enhancing Mixed Sample Data Augmentation
• Informative Dropout for Robust Representation Learning: A Shape-bias Perspective