Learning Class Unique Features in Fine-Grained Visual Classification

Abstract

A major challenge in Fine-Grained Visual Classification (FGVC) is distinguishing various categories with high inter-class similarity by learning the feature that differentiate the details. Conventional cross entropy trained Convolutional Neural Network (CNN) fails this challenge as it may suffer from producing inter-class invariant features in FGVC. In this work, we innovatively propose to regularize the training of CNN by enforcing the uniqueness of the features to each category from an information theoretic perspective. To achieve this goal, we formulate a minimax loss based on a game theoretic framework, where a Nash equilibria is proved to be consistent with this regularization objective. Besides, to prevent from a feasible solution of minimax loss that may produce redundant features, we present a Feature Redundancy Loss (FRL) based on normalized inner product between each selected feature map pair to complement the proposed minimax loss. Superior experimental results on several influential benchmarks along with visualization show that our method gives full play to the performance of the baseline model without additional computation and achieves comparable results with state-of-the-art models.

References in corpus (10)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• NIPS 2016 Tutorial: Generative Adversarial Networks
• Fine-Grained Visual Classification of Aircraft
• Regularizing Neural Networks by Penalizing Confident Output Distributions
• On the importance of single directions for generalization
• Deep CNNs Meet Global Covariance Pooling: Better Representation and Generalization
• Mask-CNN: Localizing Parts and Selecting Descriptors for Fine-Grained Image Recognition
• Revisiting the Importance of Individual Units in CNNs via Ablation
• Understanding Deep Image Representations by Inverting Them
• Region Mutual Information Loss for Semantic Segmentation