Shaping Visual Representations with Attributes for Few-Shot Recognition

Abstract

Few-shot recognition aims to recognize novel categories under low-data regimes. Some recent few-shot recognition methods introduce auxiliary semantic modality, i.e., category attribute information, into representation learning, which enhances the feature discrimination and improves the recognition performance. Most of these existing methods only consider the attribute information of support set while ignoring the query set, resulting in a potential loss of performance. In this letter, we propose a novel attribute-shaped learning (ASL) framework, which can jointly perform query attributes generation and discriminative visual representation learning for few-shot recognition. Specifically, a visual-attribute predictor (VAP) is constructed to predict the attributes of queries. By leveraging the attributes information, an attribute-visual attention module (AVAM) is designed, which can adaptively utilize attributes and visual representations to learn more discriminative features. Under the guidance of attribute modality, our method can learn enhanced semantic-aware representation for classification. Experiments demonstrate that our method can achieve competitive results on CUB and SUN benchmarks. Our source code is available at: \url{https://github.com/chenhaoxing/ASL}.

arXiv commentaccepted by IEEE Signal Process. Lett

References in corpus (9)

• Adam: A Method for Stochastic Optimization
• Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
• Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
• Prototypical Networks for Few-shot Learning
• Meta-Learning for Semi-Supervised Few-Shot Classification
• Multi-level Semantic Feature Augmentation for One-shot Learning
• Weakly Supervised Attention Pyramid Convolutional Neural Network for Fine-Grained Visual Classification
• Low-Rank Pairwise Alignment Bilinear Network For Few-Shot Fine-Grained Image Classification
• Sparse Spatial Transformers for Few-Shot Learning