Learning to Focus: Cascaded Feature Matching Network for Few-shot Image Recognition

Abstract

Deep networks can learn to accurately recognize objects of a category by training on a large number of annotated images. However, a meta-learning challenge known as a low-shot image recognition task comes when only a few images with annotations are available for learning a recognition model for one category. The objects in testing/query and training/support images are likely to be different in size, location, style, and so on. Our method, called Cascaded Feature Matching Network (CFMN), is proposed to solve this problem. We train the meta-learner to learn a more fine-grained and adaptive deep distance metric by focusing more on the features that have high correlations between compared images by the feature matching block which can align associated features together and naturally ignore those non-discriminative features. By applying the proposed feature matching block in different layers of the few-shot recognition network, multi-scale information among the compared images can be incorporated into the final cascaded matching feature, which boosts the recognition performance further and generalizes better by learning on relationships. The experiments for few-shot learning on two standard datasets, \emph{mini}ImageNet and Omniglot, have confirmed the effectiveness of our method. Besides, the multi-label few-shot task is first studied on a new data split of COCO which further shows the superiority of the proposed feature matching network when performing few-shot learning in complex images. The code will be made publicly available.

arXiv comment14 pages

References in corpus (17)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Neural Machine Translation by Jointly Learning to Align and Translate
• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
• Prototypical Networks for Few-shot Learning
• WaveNet: A Generative Model for Raw Audio
• Self-Attention Generative Adversarial Networks
• Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning
• Delta-encoder: an effective sample synthesis method for few-shot object recognition
• Learning to Remember Rare Events
• Image Transformer
• Long Short-Term Memory-Networks for Machine Reading
• Non-local Neural Networks
• Meta-learning with differentiable closed-form solvers
• RelationNet2: Deep Comparison Columns for Few-Shot Learning
• Prototype Propagation Networks (PPN) for Weakly-supervised Few-shot Learning on Category Graph

Cited by in corpus (1)

• Sparse Spatial Transformers for Few-Shot Learning