A Realistic Evaluation of Semi-Supervised Learning for Fine-Grained Classification

Abstract

We evaluate the effectiveness of semi-supervised learning (SSL) on a realistic benchmark where data exhibits considerable class imbalance and contains images from novel classes. Our benchmark consists of two fine-grained classification datasets obtained by sampling classes from the Aves and Fungi taxonomy. We find that recently proposed SSL methods provide significant benefits, and can effectively use out-of-class data to improve performance when deep networks are trained from scratch. Yet their performance pales in comparison to a transfer learning baseline, an alternative approach for learning from a few examples. Furthermore, in the transfer setting, while existing SSL methods provide improvements, the presence of out-of-class is often detrimental. In this setting, standard fine-tuning followed by distillation-based self-training is the most robust. Our work suggests that semi-supervised learning with experts on realistic datasets may require different strategies than those currently prevalent in the literature.

CVPR 2021 (oral)

References in corpus (8)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Distilling the Knowledge in a Neural Network
• Improved Regularization of Convolutional Neural Networks with Cutout
• Learning with Pseudo-Ensembles
• Billion-scale semi-supervised learning for image classification
• ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoring
• The Semi-Supervised iNaturalist-Aves Challenge at FGVC7 Workshop
• FeatMatch: Feature-Based Augmentation for Semi-Supervised Learning