11 papers
TimeVista: Exploring and Exploiting Vision-Language Models as Judges for Time Series Forecasting
Zhi Chen, Yuxuan Wang, Jialong Wu +5
High-quality time series forecasting is pivotal for real-world decision-making. However, traditional point-wise metrics often fail to reveal complex temporal patterns and align poo…
Timer-S1: A Billion-Scale Time Series Foundation Model with Serial Scaling
Yong Liu, Xingjian Su, Shiyu Wang +7
We introduce Timer-S1, a strong Mixture-of-Experts (MoE) time series foundation model with 8.3B total parameters, 0.75B activated parameters for each token, and a context length of…
Retrieval-Augmented Generation with Covariate Time Series
Kenny Ye Liang, Zhongyi Pei, Huan Zhang +3
While RAG has greatly enhanced LLMs, extending this paradigm to Time-Series Foundation Models (TSFMs) remains a challenge. This is exemplified in the Predictive Maintenance of the…
Aura: Universal Multi-dimensional Exogenous Integration for Aviation Time Series
Jiafeng Lin, Mengren Zheng, Simeng Ye +5
Time series forecasting has witnessed an increasing demand across diverse industrial applications, where accurate predictions are pivotal for informed decision-making. Beyond numer…
DiTS: Multimodal Diffusion Transformers Are Time Series Forecasters
Haoran Zhang, Haixuan Liu, Yong Liu +4
While generative modeling facilitates probabilistic time series forecasting, incorporating heterogeneous exogenous information remains challenging. Diffusion Transformers (DiT) pro…
Brep2Shape: Boundary and Shape Representation Alignment via Self-Supervised Transformers
Yuanxu Sun, Yuezhou Ma, Haixu Wu +4
Boundary representation (B-rep) is the industry standard for computer-aided design (CAD). While deep learning shows promise in processing B-rep models, existing methods suffer from…
Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale Geometries
Hang Zhou, Haixu Wu, Haonan Shangguan +4
Deep learning has emerged as a transformative tool for the neural surrogate modeling of partial differential equations (PDEs), known as neural PDE solvers. However, scaling these s…
CoRA: Covariate-Aware Adaptation of Time Series Foundation Models
Guo Qin, Zhi Chen, Yong Liu +5
Time Series Foundation Models (TSFMs) have shown significant impact through their model capacity, scalability, and zero-shot generalization. However, due to the heterogeneity of in…
Exploring Accuracy Law for Deep Time Series Forecasters: An Empirical Study
Yuxuan Wang, Haixu Wu, Yuezhou Ma +8
Deep time series forecasting has emerged as a rapidly growing field in recent years. Despite the exponential growth of community interests, progress on standard benchmarks is often…
PhySense: Sensor Placement Optimization for Accurate Physics Sensing
Yuezhou Ma, Haixu Wu, Hang Zhou +3
Physics sensing plays a central role in many scientific and engineering domains, which inherently involves two coupled tasks: reconstructing dense physical fields from sparse obser…
FlashBias: Fast Computation of Attention with Bias
Haixu Wu, Minghao Guo, Yuezhou Ma +4
Attention with bias, which extends standard attention by introducing prior knowledge as an additive bias matrix to the query-key scores, has been widely deployed in vision, languag…