Global Semantic Consistency for Zero-Shot Learning

Abstract

In image recognition, there are many cases where training samples cannot cover all target classes. Zero-shot learning (ZSL) utilizes the class semantic information to classify samples of the unseen categories that have no corresponding samples contained in the training set. In this paper, we propose an end-to-end framework, called Global Semantic Consistency Network (GSC-Net for short), which makes complete use of the semantic information of both seen and unseen classes, to support effective zero-shot learning. We also adopt a soft label embedding loss to further exploit the semantic relationships among classes. To adapt GSC-Net to a more practical setting, Generalized Zero-shot Learning (GZSL), we introduce a parametric novelty detection mechanism. Our approach achieves the state-of-the-art performance on both ZSL and GZSL tasks over three visual attribute datasets, which validates the effectiveness and advantage of the proposed framework.

References in corpus (13)

• Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms
• Zero-Shot Learning by Convex Combination of Semantic Embeddings
• Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Ugly
• Semantic Autoencoder for Zero-Shot Learning
• Zero-Shot Learning via Semantic Similarity Embedding
• Zero-Shot Learning -- The Good, the Bad and the Ugly
• A Unified Perspective on Multi-Domain and Multi-Task Learning
• Preserving Semantic Relations for Zero-Shot Learning
• An Empirical Study and Analysis of Generalized Zero-Shot Learning for Object Recognition in the Wild
• Label Embedding Network: Learning Label Representation for Soft Training of Deep Networks
• Recovering the Missing Link: Predicting Class-Attribute Associations for Unsupervised Zero-Shot Learning
• Semantically Consistent Regularization for Zero-Shot Recognition
• Learning a Deep Embedding Model for Zero-Shot Learning