Remix: Rebalanced Mixup

Abstract

Deep image classifiers often perform poorly when training data are heavily class-imbalanced. In this work, we propose a new regularization technique, Remix, that relaxes Mixup's formulation and enables the mixing factors of features and labels to be disentangled. Specifically, when mixing two samples, while features are mixed in the same fashion as Mixup, Remix assigns the label in favor of the minority class by providing a disproportionately higher weight to the minority class. By doing so, the classifier learns to push the decision boundaries towards the majority classes and balance the generalization error between majority and minority classes. We have studied the state-of-the art regularization techniques such as Mixup, Manifold Mixup and CutMix under class-imbalanced regime, and shown that the proposed Remix significantly outperforms these state-of-the-arts and several re-weighting and re-sampling techniques, on the imbalanced datasets constructed by CIFAR-10, CIFAR-100, and CINIC-10. We have also evaluated Remix on a real-world large-scale imbalanced dataset, iNaturalist 2018. The experimental results confirmed that Remix provides consistent and significant improvements over the previous methods.

arXiv comment16 pages, 4 figures, ECCV'2020 Workshop on IPCV

References in corpus (14)

• Scikit-learn: Machine Learning in Python
• SMOTE: Synthetic Minority Over-sampling Technique
• mixup: Beyond Empirical Risk Minimization
• Improved Regularization of Convolutional Neural Networks with Cutout
• ALBERT: A Lite BERT for Self-supervised Learning of Language Representations
• Interpolation Consistency Training for Semi-Supervised Learning
• CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features
• Manifold Mixup: Better Representations by Interpolating Hidden States
• Large-Margin Softmax Loss for Convolutional Neural Networks
• The Devil is in the Tails: Fine-grained Classification in the Wild
• What is the Effect of Importance Weighting in Deep Learning?
• Cost-aware Pre-training for Multiclass Cost-sensitive Deep Learning
• The iNaturalist Species Classification and Detection Dataset
• A Perspective on Objects and Systematic Generalization in Model-Based RL

Cited by in corpus (9)

• A dual-branch model with inter- and intra-branch contrastive loss for long-tailed recognition
• Combining Ensembles and Data Augmentation can Harm your Calibration
• R-Mixup: Riemannian Mixup for Biological Networks
• Feature Binding with Category-Dependant MixUp for Semantic Segmentation and Adversarial Robustness
• Non-convex Distributionally Robust Optimization: Non-asymptotic Analysis
• Graph Classification by Mixture of Diverse Experts
• Investigating Group Distributionally Robust Optimization for Deep Imbalanced Learning: A Case Study of Binary Tabular Data Classification
• Calibrating Class Activation Maps for Long-Tailed Visual Recognition
• Procrustean Training for Imbalanced Deep Learning