Structured Sequence Modeling with Graph Convolutional Recurrent Networks

Abstract

This paper introduces Graph Convolutional Recurrent Network (GCRN), a deep learning model able to predict structured sequences of data. Precisely, GCRN is a generalization of classical recurrent neural networks (RNN) to data structured by an arbitrary graph. Such structured sequences can represent series of frames in videos, spatio-temporal measurements on a network of sensors, or random walks on a vocabulary graph for natural language modeling. The proposed model combines convolutional neural networks (CNN) on graphs to identify spatial structures and RNN to find dynamic patterns. We study two possible architectures of GCRN, and apply the models to two practical problems: predicting moving MNIST data, and modeling natural language with the Penn Treebank dataset. Experiments show that exploiting simultaneously graph spatial and dynamic information about data can improve both precision and learning speed.

References in corpus (7)

• Semi-Supervised Classification with Graph Convolutional Networks
• The Emerging Field of Signal Processing on Graphs: Extending High-Dimensional Data Analysis to Networks and Other Irregular Domains
• Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation
• Recurrent Neural Network Regularization
• Learning Convolutional Neural Networks for Graphs
• Gated Graph Sequence Neural Networks
• Video (language) modeling: a baseline for generative models of natural videos

Cited by in corpus (5)

• Dynamic mode decomposition in vector-valued reproducing kernel Hilbert spaces for extracting dynamical structure among observables
• Structure Inference Net: Object Detection Using Scene-Level Context and Instance-Level Relationships
• Discrete Graph Structure Learning for Forecasting Multiple Time Series
• STEP: Spatial-Temporal Network Security Event Prediction
• Temporal Graph Network Embedding with Causal Anonymous Walks Representations