4 papers
SepSeq: A Training-Free Framework for Long Numerical Sequence Processing in LLMs
Jie Sun, Yu Liu, Lu Han +9
While transformer-based Large Language Models (LLMs) theoretically support massive context windows, they suffer from severe performance degradation when processing long numerical s…
UniCA: Unified Covariate Adaptation for Time Series Foundation Model
Lu Han, Yu Liu, Lan Li +9
Time Series Foundation Models (TSFMs) have achieved remarkable success through large-scale pretraining. However, their design primarily targets real-valued series, limiting their a…
TS-RAG: Retrieval-Augmented Generation based Time Series Foundation Models are Stronger Zero-Shot Forecaster
Kanghui Ning, Zijie Pan, Yu Liu +7
Large Language Models (LLMs) and Foundation Models (FMs) have recently become prevalent for time series forecasting tasks. While fine-tuning LLMs enables domain adaptation, they of…
Xihe: Scalable Zero-Shot Time Series Learner Via Hierarchical Interleaved Block Attention
Yinbo Sun, Yuchen Fang, Zhibo Zhu +7
The rapid advancement of time series foundation models (TSFMs) has been propelled by migrating architectures from language models. While existing TSFMs demonstrate impressive perfo…