Self-Supervised Learning For Few-Shot Image Classification
arXiv:1911.06045
Abstract
Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited number of samples for each task, the initial embedding network for meta-learning becomes an essential component and can largely affect the performance in practice. To this end, most of the existing methods highly rely on the efficient embedding network. Due to the limited labelled data, the scale of embedding network is constrained under a supervised learning(SL) manner which becomes a bottleneck of the few-shot learning methods. In this paper, we proposed to train a more generalized embedding network with self-supervised learning (SSL) which can provide robust representation for downstream tasks by learning from the data itself. We evaluate our work by extensive comparisons with previous baseline methods on two few-shot classification datasets ({\em i.e.,} MiniImageNet and CUB) and achieve better performance over baselines. Tests on four datasets in cross-domain few-shot learning classification show that the proposed method achieves state-of-the-art results and further prove the robustness of the proposed model. Our code is available at \hyperref[https://github.com/phecy/SSL-FEW-SHOT.]{https://github.com/phecy/SSL-FEW-SHOT.}
arXiv commentTo appear at ICASSP 2021. https://github.com/phecy/ssl-few-shot
References in corpus (13)
- Representation Learning with Contrastive Predictive Coding
- Prototypical Networks for Few-shot Learning
- Wide Residual Networks
- Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC)
- Data-Efficient Image Recognition with Contrastive Predictive Coding
- A Simple Neural Attentive Meta-Learner
- Learning Representations by Maximizing Mutual Information Across Views
- Contrastive Multiview Coding
- Few-Shot Learning with Graph Neural Networks
- Few-Shot Learning with Metric-Agnostic Conditional Embeddings
- Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?
- Discriminative k-shot learning using probabilistic models
- MSplit LBI: Realizing Feature Selection and Dense Estimation Simultaneously in Few-shot and Zero-shot Learning