Deep Metric Transfer for Label Propagation with Limited Annotated Data

Abstract

We study object recognition under the constraint that each object class is only represented by very few observations. Semi-supervised learning, transfer learning, and few-shot recognition all concern with achieving fast generalization with few labeled data. In this paper, we propose a generic framework that utilizes unlabeled data to aid generalization for all three tasks. Our approach is to create much more training data through label propagation from the few labeled examples to a vast collection of unannotated images. The main contribution of the paper is that we show such a label propagation scheme can be highly effective when the similarity metric used for propagation is transferred from other related domains. We test various combinations of supervised and unsupervised metric learning methods with various label propagation algorithms. We find that our framework is very generic without being sensitive to any specific techniques. By taking advantage of unlabeled data in this way, we achieve significant improvements on all three tasks.

Code is availble at http://github.com/Microsoft/metric-transfer.pytorch

References in corpus (15)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Prototypical Networks for Few-shot Learning
• Wide Residual Networks
• Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results
• Semi-Supervised Learning with Deep Generative Models
• Temporal Ensembling for Semi-Supervised Learning
• A Simple Neural Attentive Meta-Learner
• Meta-SGD: Learning to Learn Quickly for Few-Shot Learning
• Meta-Learning for Semi-Supervised Few-Shot Classification
• Semi-Supervised Learning with Ladder Networks
• Few-Shot Learning with Graph Neural Networks
• Shake-Shake regularization
• Virtual Adversarial Training: A Regularization Method for Supervised and Semi-Supervised Learning
• Improving Generalization via Scalable Neighborhood Component Analysis

Cited by in corpus (4)

• MixMatch: A Holistic Approach to Semi-Supervised Learning
• ReMixMatch: Semi-Supervised Learning with Distribution Alignment and Augmentation Anchoring
• Reference-guided Pseudo-Label Generation for Medical Semantic Segmentation
• Self-supervised Semi-supervised Learning for Data Labeling and Quality Evaluation