Towards Cross-Granularity Few-Shot Learning: Coarse-to-Fine Pseudo-Labeling with Visual-Semantic Meta-Embedding
arXiv:2007.05675 · doi:10.1145/3474085.3475200
Abstract
Few-shot learning aims at rapidly adapting to novel categories with only a handful of samples at test time, which has been predominantly tackled with the idea of meta-learning. However, meta-learning approaches essentially learn across a variety of few-shot tasks and thus still require large-scale training data with fine-grained supervision to derive a generalized model, thereby involving prohibitive annotation cost. In this paper, we advance the few-shot classification paradigm towards a more challenging scenario, i.e., cross-granularity few-shot classification, where the model observes only coarse labels during training while is expected to perform fine-grained classification during testing. This task largely relieves the annotation cost since fine-grained labeling usually requires strong domain-specific expertise. To bridge the cross-granularity gap, we approximate the fine-grained data distribution by greedy clustering of each coarse-class into pseudo-fine-classes according to the similarity of image embeddings. We then propose a meta-embedder that jointly optimizes the visual- and semantic-discrimination, in both instance-wise and coarse class-wise, to obtain a good feature space for this coarse-to-fine pseudo-labeling process. Extensive experiments and ablation studies are conducted to demonstrate the effectiveness and robustness of our approach on three representative datasets.
arXiv commentAccepted by ACM MM 2021
References in corpus (24)
- Adam: A Method for Stochastic Optimization
- Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift
- PyTorch: An Imperative Style, High-Performance Deep Learning Library
- A Simple Framework for Contrastive Learning of Visual Representations
- Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
- Prototypical Networks for Few-shot Learning
- On Calibration of Modern Neural Networks
- A Simple Neural Attentive Meta-Learner
- Meta-SGD: Learning to Learn Quickly for Few-Shot Learning
- Meta-Learning for Semi-Supervised Few-Shot Classification
- Adversarial Feature Learning
- MixMatch: A Holistic Approach to Semi-Supervised Learning
- Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning
- Deep Clustering for Unsupervised Learning of Visual Features
- Learning to Self-Train for Semi-Supervised Few-Shot Classification
- Unsupervised Learning via Meta-Learning
- One-Shot Imitation from Observing Humans via Domain-Adaptive Meta-Learning
- How to train your MAML
- Meta-Learning without Memorization
- Unsupervised Meta-Learning For Few-Shot Image Classification
- Assume, Augment and Learn: Unsupervised Few-Shot Meta-Learning via Random Labels and Data Augmentation
- Unsupervised Reinforcement Learning of Transferable Meta-Skills for Embodied Navigation
- Strength from Weakness: Fast Learning Using Weak Supervision
- Prototype Propagation Networks (PPN) for Weakly-supervised Few-shot Learning on Category Graph