Deep Learning for Spatio-Temporal Data Mining: A Survey

Abstract

With the fast development of various positioning techniques such as Global Position System (GPS), mobile devices and remote sensing, spatio-temporal data has become increasingly available nowadays. Mining valuable knowledge from spatio-temporal data is critically important to many real world applications including human mobility understanding, smart transportation, urban planning, public safety, health care and environmental management. As the number, volume and resolution of spatio-temporal datasets increase rapidly, traditional data mining methods, especially statistics based methods for dealing with such data are becoming overwhelmed. Recently, with the advances of deep learning techniques, deep leaning models such as convolutional neural network (CNN) and recurrent neural network (RNN) have enjoyed considerable success in various machine learning tasks due to their powerful hierarchical feature learning ability in both spatial and temporal domains, and have been widely applied in various spatio-temporal data mining (STDM) tasks such as predictive learning, representation learning, anomaly detection and classification. In this paper, we provide a comprehensive survey on recent progress in applying deep learning techniques for STDM. We first categorize the types of spatio-temporal data and briefly introduce the popular deep learning models that are used in STDM. Then a framework is introduced to show a general pipeline of the utilization of deep learning models for STDM. Next we classify existing literatures based on the types of ST data, the data mining tasks, and the deep learning models, followed by the applications of deep learning for STDM in different domains including transportation, climate science, human mobility, location based social network, crime analysis, and neuroscience. Finally, we conclude the limitations of current research and point out future research directions.

arXiv admin note: text overlap with arXiv:1711.04710 by other authors

References in corpus (20)

• Sequence to Sequence Learning with Neural Networks
• Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting
• Deep Learning for Short-Term Traffic Flow Prediction
• Short-Term Forecasting of Passenger Demand under On-Demand Ride Services: A Spatio-Temporal Deep Learning Approach
• Neural networks for post-processing ensemble weather forecasts
• Predicting Station-level Hourly Demands in a Large-scale Bike-sharing Network: A Graph Convolutional Neural Network Approach
• Inferring transportation modes from GPS trajectories using a convolutional neural network
• Application of Deep Convolutional Neural Networks for Detecting Extreme Weather in Climate Datasets
• Deep Multi-View Spatial-Temporal Network for Taxi Demand Prediction
• PCNN: Deep Convolutional Networks for Short-term Traffic Congestion Prediction
• Combining time-series and textual data for taxi demand prediction in event areas: a deep learning approach
• DeepRain: ConvLSTM Network for Precipitation Prediction using Multichannel Radar Data
• Human Trajectory Prediction using Spatially aware Deep Attention Models
• Generating Long-term Trajectories Using Deep Hierarchical Networks
• Graph-Based Deep Modeling and Real Time Forecasting of Sparse Spatio-Temporal Data
• Where to Go Next: A Spatio-temporal LSTM model for Next POI Recommendation
• Application of Multi-channel 3D-cube Successive Convolution Network for Convective Storm Nowcasting
• DeepSpace: An Online Deep Learning Framework for Mobile Big Data to Understand Human Mobility Patterns
• Efficient Metropolitan Traffic Prediction Based on Graph Recurrent Neural Network
• TrajectoryNet: An Embedded GPS Trajectory Representation for Point-based Classification Using Recurrent Neural Networks

Cited by in corpus (4)

• Database Meets Deep Learning: Challenges and Opportunities
• A Spatio-Temporal Spot-Forecasting Framework for Urban Traffic Prediction
• Capturing and Explaining Trajectory Singularities using Composite Signal Neural Networks
• Clustering high dimensional meteorological scenarios: results and performance index