2 papers
cs.LG2025
Frequency Matters: When Time Series Foundation Models Fail Under Spectral Shift
Tianze Wang, Sofiane Ennadir, John Pertoft +7
Time series foundation models (TSFMs) have shown strong results on public benchmarks, prompting comparisons to a "BERT moment" for time series. Their effectiveness in industrial se…
cs.LG2025
Pool Me Wisely: On the Effect of Pooling in Transformer-Based Models
Sofiane Ennadir, Levente Zólyomi, Oleg Smirnov +4
Transformer models have become the dominant backbone for sequence modeling, leveraging self-attention to produce contextualized token representations. These are typically aggregate…