Multi-Dimensional Recurrent Neural Networks

Abstract

Recurrent neural networks (RNNs) have proved effective at one dimensional sequence learning tasks, such as speech and online handwriting recognition. Some of the properties that make RNNs suitable for such tasks, for example robustness to input warping, and the ability to access contextual information, are also desirable in multidimensional domains. However, there has so far been no direct way of applying RNNs to data with more than one spatio-temporal dimension. This paper introduces multi-dimensional recurrent neural networks (MDRNNs), thereby extending the potential applicability of RNNs to vision, video processing, medical imaging and many other areas, while avoiding the scaling problems that have plagued other multi-dimensional models. Experimental results are provided for two image segmentation tasks.

10 pages, 10 figures

Cited by in corpus (11)

• Recent Advances in Recurrent Neural Networks
• A Review on Deep Learning Techniques for Video Prediction
• Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networks
• Semantic Object Parsing with Local-Global Long Short-Term Memory
• Provably Good Solutions to the Knapsack Problem via Neural Networks of Bounded Size
• SANet: Structure-Aware Network for Visual Tracking
• Learning Deep Representations for Semantic Image Parsing: a Comprehensive Overview
• Geometric Scene Parsing with Hierarchical LSTM
• Where to Focus: Deep Attention-based Spatially Recurrent Bilinear Networks for Fine-Grained Visual Recognition
• Image Recognition Using Scale Recurrent Neural Networks
• Illegible Text to Readable Text: An Image-to-Image Transformation using Conditional Sliced Wasserstein Adversarial Networks