Diversified Visual Attention Networks for Fine-Grained Object Classification

Abstract

Fine-grained object classification is a challenging task due to the subtle inter-class difference and large intra-class variation. Recently, visual attention models have been applied to automatically localize the discriminative regions of an image for better capturing critical difference and demonstrated promising performance. However, without consideration of the diversity in attention process, most of existing attention models perform poorly in classifying fine-grained objects. In this paper, we propose a diversified visual attention network (DVAN) to address the problems of fine-grained object classification, which substan- tially relieves the dependency on strongly-supervised information for learning to localize discriminative regions compared with attentionless models. More importantly, DVAN explicitly pursues the diversity of attention and is able to gather discriminative information to the maximal extent. Multiple attention canvases are generated to extract convolutional features for attention. An LSTM recurrent unit is employed to learn the attentiveness and discrimination of attention canvases. The proposed DVAN has the ability to attend the object from coarse to fine granularity, and a dynamic internal representation for classification is built up by incrementally combining the information from different locations and scales of the image. Extensive experiments con- ducted on CUB-2011, Stanford Dogs and Stanford Cars datasets have demonstrated that the proposed diversified visual attention networks achieve competitive performance compared to the state- of-the-art approaches, without using any prior knowledge, user interaction or external resource in training or testing.

Cited by in corpus (16)

• Attention Mechanisms in Computer Vision: A Survey
• Object-Part Attention Model for Fine-grained Image Classification
• Low-Rank Pairwise Alignment Bilinear Network For Few-Shot Fine-Grained Image Classification
• What-and-Where to Match: Deep Spatially Multiplicative Integration Networks for Person Re-identification
• Transformer with Peak Suppression and Knowledge Guidance for Fine-grained Image Recognition
• Pay attention to the activations: a modular attention mechanism for fine-grained image recognition
• A Two-Stage Attentive Network for Single Image Super-Resolution
• PDANet: Polarity-consistent Deep Attention Network for Fine-grained Visual Emotion Regression
• Visual Attention Network for Low Dose CT
• Learning Contrastive Self-Distillation for Ultra-Fine-Grained Visual Categorization Targeting Limited Samples
• Object Discovery From a Single Unlabeled Image by Mining Frequent Itemset With Multi-scale Features
• Part-Aware Fine-grained Object Categorization using Weakly Supervised Part Detection Network
• Embedding Deep Networks into Visual Explanations
• Mask Guided Attention For Fine-Grained Patchy Image Classification
• Deep Attention-guided Hashing
• I2CANSAY:Inter-Class Analogical Augmentation and Intra-Class Significance Analysis for Non-Exemplar Online Task-Free Continual Learning