6 citations · 14 across the 16 of their papers we have counts for
10 papers · 1 filter
Mesh-Native Tokenisation: Retrofitting Foundation Models to Unstructured Data
Georg Maierhofer, Miles Cranmer, Payel Mukhopadhyay
Physics foundation models are an increasingly popular approach for building versatile emulators for spatiotemporal systems. They require tokenisation layers that lift physical fiel…
Machine Can Automatically Discover Parametric Functions to Model HEP Data
Ho Fung Tsoi, Dylan Rankin, Cecile Caillol +5
In HEP data analyses, finding an adequate function to model binned data has largely relied on a manual process: guess a functional form by intuition, fit, examine, then repeat unti…
Gaussian Process Latent Factor Regression for Low-Data, High-Dimensional Output Problems
Edward T. Stevenson, Eric T. Wolf, Mei Ting Mak +2
In the sciences, regression tasks often require predicting high-dimensional outputs from few training examples. Multi-output Gaussian processes excel in low-data regimes but typica…
Otter Weather: Skillful and Computationally Efficient Medium-Range Weather Forecasting
Cristiana Diaconu, Jonas Scholz, Aliaksandra Shysheya +4
State-of-the-art medium-range AI weather models can outperform traditional Numerical Weather Prediction (NWP) but require massive training budgets. This restricts usage for under-r…
ThousandWorlds: A benchmark for climate emulation of potentially habitable exoplanets
Edward T. Stevenson, Mei Ting Mak, Eric Wolf +4
The search for life beyond Earth will depend on detecting faint signatures in the atmospheres of potentially habitable exoplanets. Interpreting those signatures requires understand…
CTF4Nuclear: Common Task Framework for Nuclear Fission and Fusion Models
Stefano Riva, Carolina Introini, Antonio Cammi +13
The demand for clean energy is ever increasing, with new nuclear technologies presenting a complementary solution to renewable energies. However, designing and operating these syst…
MIMIC: A Generative Multimodal Foundation Model for Biomolecules
Siavash Golkar, Jake Kovalic, Irina Espejo Morales +28
Biological function emerges from coupled constraints across sequence, structure, regulation, evolution, and cellular context, yet most foundation models in biology are trained with…
On the Value of Tokeniser Pretraining in Physics Foundation Models
Hadi Sotoudeh, Payel Mukhopadhyay, Ruben Ohana +4
We investigate the impact of tokeniser pretraining on the accuracy and efficiency of physics emulation. Modern high-resolution simulations produce vast volumes of data spanning div…
Probabilistic Retrofitting of Learned Simulators
Cristiana Diaconu, Miles Cranmer, Richard E. Turner +2
Dominant approaches for modelling Partial Differential Equations (PDEs) rely on deterministic predictions, yet many physical systems of interest are inherently chaotic and uncertai…
SymTorch: Symbolic Distillation of Neural Networks
Elizabeth S. Z. Tan, Adil Soubki, Miles Cranmer
What mathematical functions do neural network components learn? Symbolic distillation addresses this question by expressing neural network components with interpretable, closed-for…