Dense Recurrent Neural Networks for Scene Labeling

Abstract

Recently recurrent neural networks (RNNs) have demonstrated the ability to improve scene labeling through capturing long-range dependencies among image units. In this paper, we propose dense RNNs for scene labeling by exploring various long-range semantic dependencies among image units. In comparison with existing RNN based approaches, our dense RNNs are able to capture richer contextual dependencies for each image unit via dense connections between each pair of image units, which significantly enhances their discriminative power. Besides, to select relevant and meanwhile restrain irrelevant dependencies for each unit from dense connections, we introduce an attention model into dense RNNs. The attention model enables automatically assigning more importance to helpful dependencies while less weight to unconcerned dependencies. Integrating with convolutional neural networks (CNNs), our method achieves state-of-the-art performances on the PASCAL Context, MIT ADE20K and SiftFlow benchmarks.

arXiv commentTech. Report

References in corpus (22)

• Neural Machine Translation by Jointly Learning to Align and Translate
• Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
• Deep Residual Learning for Image Recognition
• Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs
• Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
• Multi-Scale Context Aggregation by Dilated Convolutions
• Hierarchical Question-Image Co-Attention for Visual Question Answering
• ParseNet: Looking Wider to See Better
• Fully Convolutional Networks for Semantic Segmentation
• DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs
• MatConvNet - Convolutional Neural Networks for MATLAB
• Learning Deconvolution Network for Semantic Segmentation
• Rich feature hierarchies for accurate object detection and semantic segmentation
• Convolutional Feature Masking for Joint Object and Stuff Segmentation
• Semantic Image Segmentation via Deep Parsing Network
• BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation
• Attention to Scale: Scale-aware Semantic Image Segmentation
• Learning Contextual Dependencies with Convolutional Hierarchical Recurrent Neural Networks
• Multi-Context Attention for Human Pose Estimation
• PixelNet: Representation of the pixels, by the pixels, and for the pixels
• Scene Parsing with Global Context Embedding
• Top-Down Learning for Structured Labeling with Convolutional Pseudoprior