8 papers
Pre-Training for Simulation-Based Science: A Study on Jet Foundation Model Training Objectives
Ibrahim Elsharkawy, Joschka Birk, Vinicius Mikuni +3
Foundation models (FMs) trained on large datasets and fine-tuned on downstream tasks have emerged as a powerful paradigm in AI for science. Industrial FMs are typically trained usi…
OmniMol: Transferring Particle Physics Knowledge to Molecular Dynamics with Point-Edge Transformers
Ibrahim Elsharkawy, Vinicius Mikuni, Wahid Bhimji +1
We present OmniMol, a state-of-the-art all-to-all transformer-based small molecule machine-learned interatomic potential (MLIP). OmniMol is built by adapting Omnilearned, a foundat…
Generative models on phase space
Zachary Bogorad, Ibrahim Elsharkawy, Yonatan Kahn +2
Deep generative models such as diffusion and flow matching are powerful machine learning tools capable of learning and sampling from high-dimensional distributions. They are partic…
FAIR Universe Weak Lensing ML Uncertainty Challenge: Handling Uncertainties and Distribution Shifts for Precision Cosmology
Biwei Dai, Po-Wen Chang, Wahid Bhimji +15
Weak gravitational lensing, the correlated distortion of background galaxy shapes by foreground structures, is a powerful probe of the matter distribution in our universe and allow…
OmniCosmos: Transferring Particle Physics Knowledge Across the Cosmos
Vinicius Mikuni, Ibrahim Elsharkawy, Benjamin Nachman
Foundation models build an effective representations of data that can be deployed on diverse downstream tasks. Previous research developed the OmniLearned foundation model for coll…
FAIR Universe HiggsML Uncertainty Dataset and Competition
Lisa Benato, Wahid Bhimji, Paolo Calafiura +26
The FAIR Universe HiggsML Uncertainty Challenge focused on measuring the physical properties of elementary particles with imperfect simulators. Participants were required to comput…