ST-UNet: A Spatio-Temporal U-Network for Graph-structured Time Series Modeling

Abstract

The spatio-temporal graph learning is becoming an increasingly important object of graph study. Many application domains involve highly dynamic graphs where temporal information is crucial, e.g. traffic networks and financial transaction graphs. Despite the constant progress made on learning structured data, there is still a lack of effective means to extract dynamic complex features from spatio-temporal structures. Particularly, conventional models such as convolutional networks or recurrent neural networks are incapable of revealing the temporal patterns in short or long terms and exploring the spatial properties in local or global scope from spatio-temporal graphs simultaneously. To tackle this problem, we design a novel multi-scale architecture, Spatio-Temporal U-Net (ST-UNet), for graph-structured time series modeling. In this U-shaped network, a paired sampling operation is proposed in spacetime domain accordingly: the pooling (ST-Pool) coarsens the input graph in spatial from its deterministic partition while abstracts multi-resolution temporal dependencies through dilated recurrent skip connections; based on previous settings in the downsampling, the unpooling (ST-Unpool) restores the original structure of spatio-temporal graphs and resumes regular intervals within graph sequences. Experiments on spatio-temporal prediction tasks demonstrate that our model effectively captures comprehensive features in multiple scales and achieves substantial improvements over mainstream methods on several real-world datasets.

References in corpus (8)

• Sequence to Sequence Learning with Neural Networks
• Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
• Semi-Supervised Classification with Graph Convolutional Networks
• Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
• The Emerging Field of Signal Processing on Graphs: Extending High-Dimensional Data Analysis to Networks and Other Irregular Domains
• Inductive Representation Learning on Large Graphs
• Spectral Networks and Locally Connected Networks on Graphs
• A Clockwork RNN

Cited by in corpus (10)

• Graph Neural Network for Traffic Forecasting: A Survey
• How to Build a Graph-Based Deep Learning Architecture in Traffic Domain: A Survey
• Thermodynamics-informed graph neural networks
• HighAir: A Hierarchical Graph Neural Network-Based Air Quality Forecasting Method
• An Overview on the Application of Graph Neural Networks in Wireless Networks
• Graph Representation Learning via Hard and Channel-Wise Attention Networks
• Efficient Colon Cancer Grading with Graph Neural Networks
• An Empirical Experiment on Deep Learning Models for Predicting Traffic Data
• A Graph Convolutional Network with Signal Phasing Information for Arterial Traffic Prediction
• Incorporating Reachability Knowledge into a Multi-Spatial Graph Convolution Based Seq2Seq Model for Traffic Forecasting