MemDA: Forecasting Urban Time Series with Memory-based Drift Adaptation

Abstract

Urban time series data forecasting featuring significant contributions to sustainable development is widely studied as an essential task of the smart city. However, with the dramatic and rapid changes in the world environment, the assumption that data obey Independent Identically Distribution is undermined by the subsequent changes in data distribution, known as concept drift, leading to weak replicability and transferability of the model over unseen data. To address the issue, previous approaches typically retrain the model, forcing it to fit the most recent observed data. However, retraining is problematic in that it leads to model lag, consumption of resources, and model re-invalidation, causing the drift problem to be not well solved in realistic scenarios. In this study, we propose a new urban time series prediction model for the concept drift problem, which encodes the drift by considering the periodicity in the data and makes on-the-fly adjustments to the model based on the drift using a meta-dynamic network. Experiments on real-world datasets show that our design significantly outperforms state-of-the-art methods and can be well generalized to existing prediction backbones by reducing their sensitivity to distribution changes.

arXiv commentAccepted by CIKM 2023

References in corpus (9)

• Spatio-Temporal Graph Convolutional Networks: A Deep Learning Framework for Traffic Forecasting
• T-GCN: A Temporal Graph ConvolutionalNetwork for Traffic Prediction
• The information bottleneck method
• Adaptive Graph Convolutional Recurrent Network for Traffic Forecasting
• MINE: Mutual Information Neural Estimation
• Spatial-Temporal Transformer Networks for Traffic Flow Forecasting
• Non-stationary Transformers: Exploring the Stationarity in Time Series Forecasting
• DL-Traff: Survey and Benchmark of Deep Learning Models for Urban Traffic Prediction
• AdaRNN: Adaptive Learning and Forecasting of Time Series

Cited by in corpus (1)

• Scalable Transformer for High Dimensional Multivariate Time Series Forecasting