6 papers · 1 filter
Demystifying Data-Driven Probabilistic Medium-Range Weather Forecasting
Jean Kossaifi, Nikola Kovachki, Morteza Mardani +15
The recent revolution in data-driven methods for weather forecasting has lead to a fragmented landscape of complex, bespoke architectures and training strategies, obscuring the fun…
MoWE : A Mixture of Weather Experts
Dibyajyoti Chakraborty, Romit Maulik, Peter Harrington +3
Data-driven weather models have recently achieved state-of-the-art performance, yet progress has plateaued in recent years. This paper introduces a Mixture of Experts (MoWE) approa…
Huge Ensembles Part II: Properties of a Huge Ensemble of Hindcasts Generated with Spherical Fourier Neural Operators
Ankur Mahesh, William Collins, Boris Bonev +12
In Part I, we created an ensemble based on Spherical Fourier Neural Operators. As initial condition perturbations, we used bred vectors, and as model perturbations, we used multipl…
Hierarchical Conditional Multi-Task Learning for Streamflow Modeling
Shaoming Xu, Arvind Renganathan, Ankush Khandelwal +9
Streamflow, vital for water resource management, is governed by complex hydrological systems involving intermediate processes driven by meteorological forces. While deep learning m…
Comprehensive Performance Modeling and System Design Insights for Foundation Models
Shashank Subramanian, Ermal Rrapaj, Peter Harrington +6
Generative AI, in particular large transformer models, are increasingly driving HPC system design in science and industry. We analyze performance characteristics of such transforme…
Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Prediction
Jared D. Willard, Peter Harrington, Shashank Subramanian +3
The rapid rise of deep learning (DL) in numerical weather prediction (NWP) has led to a proliferation of models which forecast atmospheric variables with comparable or superior ski…