4 papers
Test-Time Training with KV Binding Is Secretly Linear Attention
Junchen Liu, Sven Elflein, Or Litany +2
Test-time training (TTT) with KV binding as sequence modeling layer is commonly interpreted as a form of online meta-learning that memorizes a key-value mapping at test time. Howev…
GENSR: Symbolic Regression Based in Equation Generative Space
Qian Li, Yuxiao Hu, Juncheng Liu +1
Symbolic Regression (SR) tries to reveal the hidden equations behind observed data. However, most methods search within a discrete equation space, where the structural modification…
Moirai 2.0: When Less Is More for Time Series Forecasting
Chenghao Liu, Taha Aksu, Juncheng Liu +7
We introduce Moirai 2.0, a decoder-only time-series foundation model trained on a new corpus of 36M series. The model adopts quantile forecasting and multi-token prediction, improv…
Empowering Time Series Analysis with Synthetic Data: A Survey and Outlook in the Era of Foundation Models
Xu Liu, Taha Aksu, Juncheng Liu +7
Time series analysis is crucial for understanding dynamics of complex systems. Recent advances in foundation models have led to task-agnostic Time Series Foundation Models (TSFMs)…