A Spatial-Temporal Decomposition Based Deep Neural Network for Time Series Forecasting

Abstract

Spatial time series forecasting problems arise in a broad range of applications, such as environmental and transportation problems. These problems are challenging because of the existence of specific spatial, short-term and long-term patterns, and the curse of dimensionality. In this paper, we propose a deep neural network framework for large-scale spatial time series forecasting problems. We explicitly designed the neural network architecture for capturing various types of patterns. In preprocessing, a time series decomposition method is applied to separately feed short-term, long-term and spatial patterns into different components of a neural network. A fuzzy clustering method finds cluster of neighboring time series based on similarity of time series residuals; as they can be meaningful short-term patterns for spatial time series. In neural network architecture, each kernel of a multi-kernel convolution layer is applied to a cluster of time series to extract short-term features in neighboring areas. The output of convolution layer is concatenated by trends and followed by convolution-LSTM layer to capture long-term patterns in larger regional areas. To make a robust prediction when faced with missing data, an unsupervised pretrained denoising autoencoder reconstructs the output of the model in a fine-tuning step. The experimental results illustrate the model outperforms baseline and state of the art models in a traffic flow prediction dataset.

References in corpus (7)

• Adam: A Method for Stochastic Optimization
• Spectral Networks and Locally Connected Networks on Graphs
• Deep Convolutional Networks on Graph-Structured Data
• Deep Learning for Short-Term Traffic Flow Prediction
• Diffusion Convolutional Recurrent Neural Network: Data-Driven Traffic Forecasting
• Grouped Convolutional Neural Networks for Multivariate Time Series
• DeepTransport: Learning Spatial-Temporal Dependency for Traffic Condition Forecasting

Cited by in corpus (2)

• A convolution recurrent autoencoder for spatio-temporal missing data imputation
• Deep Reinforcement Learning for Portfolio Optimization using Latent Feature State Space (LFSS) Module