10 papers
Comparing and Contrasting DLWP Backbones on Navier-Stokes and Atmospheric Dynamics
Matthias Karlbauer, Danielle C. Maddix, Abdul Fatir Ansari +5
A large number of Deep Learning Weather Prediction (DLWP) architectures -- based on various backbones, including U-Net, Transformer, Graph Neural Network, and Fourier Neural Operat…
End-to-End Probabilistic Framework for Learning with Hard Constraints
Utkarsh Utkarsh, Danielle C. Maddix, Ruijun Ma +2
We present ProbHardE2E, a probabilistic forecasting framework that incorporates hard operational/physical constraints, and provides uncertainty quantification. Our methodology uses…
Mitra: Mixed Synthetic Priors for Enhancing Tabular Foundation Models
Xiyuan Zhang, Danielle C. Maddix, Junming Yin +11
Since the seminal work of TabPFN, research on tabular foundation models (TFMs) based on in-context learning (ICL) has challenged long-standing paradigms in machine learning. Withou…
Understanding the Implicit Biases of Design Choices for Time Series Foundation Models
Annan Yu, Danielle C. Maddix, Boran Han +7
Time series foundation models (TSFMs) are a class of potentially powerful, general-purpose tools for time series forecasting and related temporal tasks, but their behavior is stron…
Understanding Transformers for Time Series: Rank Structure, Flow-of-ranks, and Compressibility
Annan Yu, Danielle C. Maddix, Boran Han +7
Transformers are widely used across data modalities, and yet the principles distilled from text models often transfer imperfectly to models trained to other modalities. In this pap…
When Does Multimodality Lead to Better Time Series Forecasting?
Xiyuan Zhang, Boran Han, Haoyang Fang +11
Recently, there has been growing interest in incorporating textual information into foundation models for time series forecasting. However, it remains unclear whether and under wha…