Geometric Neural Phrase Pooling: Modeling the Spatial Co-occurrence of Neurons
arXiv:1607.06514
Abstract
Deep Convolutional Neural Networks (CNNs) are playing important roles in state-of-the-art visual recognition. This paper focuses on modeling the spatial co-occurrence of neuron responses, which is less studied in the previous work. For this, we consider the neurons in the hidden layer as neural words, and construct a set of geometric neural phrases on top of them. The idea that grouping neural words into neural phrases is borrowed from the Bag-of-Visual-Words (BoVW) model. Next, the Geometric Neural Phrase Pooling (GNPP) algorithm is proposed to efficiently encode these neural phrases. GNPP acts as a new type of hidden layer, which punishes the isolated neuron responses after convolution, and can be inserted into a CNN model with little extra computational overhead. Experimental results show that GNPP produces significant and consistent accuracy gain in image classification.
arXiv commentTo appear, in ECCV 2016 (18 pages, 4 figures)
References in corpus (5)
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks
- Improving neural networks by preventing co-adaptation of feature detectors
- DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition
- Stochastic Pooling for Regularization of Deep Convolutional Neural Networks