4 papers · 1 filter
TSFMAudit: Data Contamination Auditing in Forecasting Time Series Foundation Models
Hongkai Li, Shifeng Xie, Lefei Shen +7
Time series foundation models (TSFMs) are increasingly pretrained on large corpora, raising concerns that evaluation datasets may have been exposed during pretraining and thus yiel…
The Power of Architecture: Deep Dive into Transformer Architectures for Long-Term Time Series Forecasting
Lefei Shen, Mouxiang Chen, Han Fu +5
Transformer-based models have recently become dominant in Long-term Time Series Forecasting (LTSF), yet the variations in their architecture, such as encoder-only, encoder-decoder,…
Parallel Scaling Law for Language Models
Mouxiang Chen, Binyuan Hui, Zeyu Cui +5
It is commonly believed that scaling language models should commit a significant space or time cost, by increasing the parameters (parameter scaling) or output tokens (inference-ti…
Calibration of Time-Series Forecasting: Detecting and Adapting Context-Driven Distribution Shift
Mouxiang Chen, Lefei Shen, Han Fu +3
Recent years have witnessed the success of introducing deep learning models to time series forecasting. From a data generation perspective, we illustrate that existing models are s…