Publications (20)
Multiple Physics Pretraining for Physical Surrogate Models
Michael McCabe, Bruno Régaldo-Saint Blancard, Liam Holden Parker +11
Contextual Counting: A Mechanistic Study of Transformers on a Quantitative Task
Siavash Golkar, Alberto Bietti, Mariel Pettee +12
Mapper Comparison with Wasserstein Metrics
Michael McCabe
On the Origin and Evolution of Life in the Galaxy
Michael McCabe, Holly Lucas
Predicting partially observable dynamical systems via diffusion models with a multiscale inference scheme
Rudy Morel, Francesco Pio Ramunno, Jeff Shen +18
Representation Learning for Spatiotemporal Physical Systems
Helen Qu, Rudy Morel, Michael McCabe +4
Physics Steering: Causal Control of Cross-Domain Concepts in a Physics Foundation Model
Rio Alexa Fear, Payel Mukhopadhyay, Michael McCabe +2
Learning to Assimilate in Chaotic Dynamical Systems
Michael McCabe, Jed Brown
Overtone: Cyclic Patch Modulation for Clean, Efficient, and Flexible Physics Emulators
Payel Mukhopadhyay, Michael McCabe, Ruben Ohana +1
AION-1: Omnimodal Foundation Model for Astronomical Sciences
Liam Parker, Francois Lanusse, Jeff Shen +24
Towards Stability of Autoregressive Neural Operators
Michael McCabe, Peter Harrington, Shashank Subramanian +1
Lost in Latent Space: An Empirical Study of Latent Diffusion Models for Physics Emulation
François Rozet, Ruben Ohana, Michael McCabe +3
MIMIC: A Generative Multimodal Foundation Model for Biomolecules
Siavash Golkar, Jake Kovalic, Irina Espejo Morales +28
Emergent Transfer of a Physics Foundation Model from Simulation to Laboratory Turbulence
Payel Mukhopadhyay, Stefan S. Nixon, Romain Watteaux +20
On the Value of Tokeniser Pretraining in Physics Foundation Models
Hadi Sotoudeh, Payel Mukhopadhyay, Ruben Ohana +4
Universal Spectral Tokenization via Self-Supervised Panchromatic Representation Learning
Jeff Shen, Francois Lanusse, Liam Holden Parker +24
The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learning
Ruben Ohana, Michael McCabe, Lucas Meyer +24
AstroCLIP: A Cross-Modal Foundation Model for Galaxies
Liam Parker, Francois Lanusse, Siavash Golkar +12
Walrus: A Cross-Domain Foundation Model for Continuum Dynamics
Michael McCabe, Payel Mukhopadhyay, Tanya Marwah +22
xVal: A Continuous Numerical Tokenization for Scientific Language Models
Siavash Golkar, Mariel Pettee, Michael Eickenberg +11