B-CNN: Branch Convolutional Neural Network for Hierarchical Classification

Abstract

Convolutional Neural Network (CNN) image classifiers are traditionally designed to have sequential convolutional layers with a single output layer. This is based on the assumption that all target classes should be treated equally and exclusively. However, some classes can be more difficult to distinguish than others, and classes may be organized in a hierarchy of categories. At the same time, a CNN is designed to learn internal representations that abstract from the input data based on its hierarchical layered structure. So it is natural to ask if an inverse of this idea can be applied to learn a model that can predict over a classification hierarchy using multiple output layers in decreasing order of class abstraction. In this paper, we introduce a variant of the traditional CNN model named the Branch Convolutional Neural Network (B-CNN). A B-CNN model outputs multiple predictions ordered from coarse to fine along the concatenated convolutional layers corresponding to the hierarchical structure of the target classes, which can be regarded as a form of prior knowledge on the output. To learn with B-CNNs a novel training strategy, named the Branch Training strategy (BT-strategy), is introduced which balances the strictness of the prior with the freedom to adjust parameters on the output layers to minimize the loss. In this way we show that CNN based models can be forced to learn successively coarse to fine concepts in the internal layers at the output stage, and that hierarchical prior knowledge can be adopted to boost CNN models' classification performance. Our models are evaluated to show that the B-CNN extensions improve over the corresponding baseline CNN on the benchmark datasets MNIST, CIFAR-10 and CIFAR-100.

9 pages, 8 figures

References in corpus (10)

• Very Deep Convolutional Networks for Large-Scale Image Recognition
• Improving neural networks by preventing co-adaptation of feature detectors
• Deep Residual Learning for Image Recognition
• Striving for Simplicity: The All Convolutional Net
• Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)
• OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks
• DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
• Stochastic Pooling for Regularization of Deep Convolutional Neural Networks
• All you need is a good init
• Structured Prediction Energy Networks

Cited by in corpus (12)

• Towards Automated ICD Coding Using Deep Learning
• Light-weight CNN-based VVC Inter Partitioning Acceleration
• A Systematic Literature Review of Automated ICD Coding and Classification Systems using Discharge Summaries
• Hyperbolic Interaction Model For Hierarchical Multi-Label Classification
• Memory-Efficient Semi-Supervised Continual Learning: The World is its Own Replay Buffer
• HSD-CNN: Hierarchically self decomposing CNN architecture using class specific filter sensitivity analysis
• E-PixelHop: An Enhanced PixelHop Method for Object Classification
• Video-based Hierarchical Species Classification for Longline Fishing Monitoring
• Semi-Supervised Learning with Taxonomic Labels
• A class-driven hierarchical ResNet for classification of multispectral remote sensing images
• Hierarchical Auxiliary Learning
• United We Learn Better: Harvesting Learning Improvements From Class Hierarchies Across Tasks