368 citations · 736 across the 32 of their papers we have counts for
6 papers · 1 filter
Enhancing Foundation Models for Time Series Forecasting via Wavelet-based Tokenization
Luca Masserano, Abdul Fatir Ansari, Boran Han +8
How to best develop foundational models for time series forecasting remains an important open question. Tokenization is a crucial consideration in this effort: what is an effective…
Gradient-Free Generation for Hard-Constrained Systems
Chaoran Cheng, Boran Han, Danielle C. Maddix +4
Generative models that satisfy hard constraints are critical in many scientific and engineering applications, where physical laws or system requirements must be strictly respected.…
Comparing and Contrasting DLWP Backbones on Navier-Stokes and Atmospheric Dynamics
Matthias Karlbauer, Danielle C. Maddix, Abdul Fatir Ansari +5
A large number of Deep Learning Weather Prediction (DLWP) architectures -- based on various backbones, including U-Net, Transformer, Graph Neural Network, and Fourier Neural Operat…
Transferring Knowledge from Large Foundation Models to Small Downstream Models
Shikai Qiu, Boran Han, Danielle C. Maddix +3
How do we transfer the relevant knowledge from ever larger foundation models into small, task-specific downstream models that can run at much lower costs? Standard transfer learnin…
Using Uncertainty Quantification to Characterize and Improve Out-of-Domain Learning for PDEs
S. Chandra Mouli, Danielle C. Maddix, Shima Alizadeh +4
Existing work in scientific machine learning (SciML) has shown that data-driven learning of solution operators can provide a fast approximate alternative to classical numerical par…
Chronos: Learning the Language of Time Series
Abdul Fatir Ansari, Lorenzo Stella, Caner Turkmen +15
We introduce Chronos, a simple yet effective framework for pretrained probabilistic time series models. Chronos tokenizes time series values using scaling and quantization into a f…