MixSeq: Connecting Macroscopic Time Series Forecasting with Microscopic Time Series Data
arXiv:2110.14354
Abstract
Time series forecasting is widely used in business intelligence, e.g., forecast stock market price, sales, and help the analysis of data trend. Most time series of interest are macroscopic time series that are aggregated from microscopic data. However, instead of directly modeling the macroscopic time series, rare literature studied the forecasting of macroscopic time series by leveraging data on the microscopic level. In this paper, we assume that the microscopic time series follow some unknown mixture probabilistic distributions. We theoretically show that as we identify the ground truth latent mixture components, the estimation of time series from each component could be improved because of lower variance, thus benefitting the estimation of macroscopic time series as well. Inspired by the power of Seq2seq and its variants on the modeling of time series data, we propose Mixture of Seq2seq (MixSeq), an end2end mixture model to cluster microscopic time series, where all the components come from a family of Seq2seq models parameterized by different parameters. Extensive experiments on both synthetic and real-world data show the superiority of our approach.
arXiv comment15 pages, 2 figures, NeurIPS 2021
References in corpus (14)
- Sequence to Sequence Learning with Neural Networks
- Natural Scales in Geographical Patterns
- An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling
- Time Series Forecasting With Deep Learning: A Survey
- Recurrent Neural Networks for Time Series Forecasting: Current Status and Future Directions
- On the Properties of Neural Machine Translation: Encoder-Decoder Approaches
- Enhancing the Locality and Breaking the Memory Bottleneck of Transformer on Time Series Forecasting
- Deep Transformer Models for Time Series Forecasting: The Influenza Prevalence Case
- A Multi-Horizon Quantile Recurrent Forecaster
- Deep Temporal Clustering : Fully Unsupervised Learning of Time-Domain Features
- Temporal Convolutional Attention-based Network For Sequence Modeling
- Time Series Analysis and Modeling to Forecast: a Survey
- Unsupervised Discrete Sentence Representation Learning for Interpretable Neural Dialog Generation
- Deep Factors with Gaussian Processes for Forecasting