A Strong Baseline for Semi-Supervised Incremental Few-Shot Learning

Abstract

Few-shot learning (FSL) aims to learn models that generalize to novel classes with limited training samples. Recent works advance FSL towards a scenario where unlabeled examples are also available and propose semi-supervised FSL methods. Another line of methods also cares about the performance of base classes in addition to the novel ones and thus establishes the incremental FSL scenario. In this paper, we generalize the above two under a more realistic yet complex setting, named by Semi-Supervised Incremental Few-Shot Learning (S2 I-FSL). To tackle the task, we propose a novel paradigm containing two parts: (1) a well-designed meta-training algorithm for mitigating ambiguity between base and novel classes caused by unreliable pseudo labels and (2) a model adaptation mechanism to learn discriminative features for novel classes while preserving base knowledge using few labeled and all the unlabeled data. Extensive experiments on standard FSL, semi-supervised FSL, incremental FSL, and the firstly built S2 I-FSL benchmarks demonstrate the effectiveness of our proposed method.

Accepted by BMVC2021

References in corpus (14)

• Distilling the Knowledge in a Neural Network
• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Prototypical Networks for Few-shot Learning
• Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning
• Cross-Domain Few-Shot Classification via Learned Feature-Wise Transformation
• TapNet: Neural Network Augmented with Task-Adaptive Projection for Few-Shot Learning
• Low-Shot Learning from Imaginary Data
• Transductive Information Maximization For Few-Shot Learning
• Transductive Episodic-Wise Adaptive Metric for Few-Shot Learning
• Leveraging the Feature Distribution in Transfer-based Few-Shot Learning
• DPGN: Distribution Propagation Graph Network for Few-shot Learning
• XtarNet: Learning to Extract Task-Adaptive Representation for Incremental Few-Shot Learning
• How to trust unlabeled data? Instance Credibility Inference for Few-Shot Learning
• PTN: A Poisson Transfer Network for Semi-supervised Few-shot Learning