Sequential Random Network for Fine-grained Image Classification

Abstract

Deep Convolutional Neural Network (DCNN) and Transformer have achieved remarkable successes in image recognition. However, their performance in fine-grained image recognition is still difficult to meet the requirements of actual needs. This paper proposes a Sequence Random Network (SRN) to enhance the performance of DCNN. The output of DCNN is one-dimensional features. This one-dimensional feature abstractly represents image information, but it does not express well the detailed information of image. To address this issue, we use the proposed SRN which composed of BiLSTM and several Tanh-Dropout blocks (called BiLSTM-TDN), to further process DCNN one-dimensional features for highlighting the detail information of image. After the feature transform by BiLSTM-TDN, the recognition performance has been greatly improved. We conducted the experiments on six fine-grained image datasets. Except for FGVC-Aircraft, the accuracies of the proposed methods on the other datasets exceeded 99%. Experimental results show that BiLSTM-TDN is far superior to the existing state-of-the-art methods. In addition to DCNN, BiLSTM-TDN can also be extended to other models, such as Transformer.

arXiv commentThe performance of the model is very severely affected by the order of the test samples

References in corpus (19)

• Transformers in Vision: A Survey
• Wide Residual Networks
• Fine-Grained Visual Classification of Aircraft
• The Devil is in the Channels: Mutual-Channel Loss for Fine-Grained Image Classification
• Bird Species Categorization Using Pose Normalized Deep Convolutional Nets
• Object-Part Attention Model for Fine-grained Image Classification
• Xception: Deep Learning with Depthwise Separable Convolutions
• Neural Architecture Transfer
• SpinalNet: Deep Neural Network with Gradual Input
• Script Identification in Natural Scene Image and Video Frame using Attention based Convolutional-LSTM Network
• Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networks
• Domain Adaptive Transfer Learning with Specialist Models
• Power Normalizations in Fine-grained Image, Few-shot Image and Graph Classification
• Bilinear CNNs for Fine-grained Visual Recognition
• Compounding the Performance Improvements of Assembled Techniques in a Convolutional Neural Network
• Scalable Transfer Learning with Expert Models
• Multi-branch and Multi-scale Attention Learning for Fine-Grained Visual Categorization
• Rethinking Recurrent Neural Networks and Other Improvements for Image Classification
• SurfConv: Bridging 3D and 2D Convolution for RGBD Images