6 papers
Sim+Real: Joint Simulation-Experiment Training Improves Balanced Prediction in Physical Systems
Mahindra Rautela, Alexander Scheinker, Ayan Biswas +3
Simulation and experimental measurements provide complementary data for learning spatiotemporal physical systems, but standard simulation-to-experiment fine-tuning optimizes only t…
Out-of-distribution transfer of PDE foundation models to material dynamics under extreme loading
Mahindra Rautela, Alexander Most, Siddharth Mansingh +9
Most PDE foundation models are pretrained and fine-tuned on fluid-centric benchmarks. Their utility under extreme-loading material dynamics remains unclear. We benchmark out-of-dis…
Loss Landscape Geometry of Partial Differential Equation Emulators: Or, Symmetry Learning via Gradient Alignment
James Amarel, Robyn Miller, Nicolas Hengartner +5
We study how neural emulators of partial differential equation solution operators internalize physical symmetries by introducing an influence-based diagnostic that measures the pro…
MORPH: PDE Foundation Models with Arbitrary Data Modality
Mahindra Singh Rautela, Alexander Most, Siddharth Mansingh +6
We introduce MORPH, a modality-agnostic, autoregressive foundation model for partial differential equations (PDEs). MORPH is built on a convolutional vision transformer backbone th…
Towards Reasoning for PDE Foundation Models: A Reward-Model-Driven Inference-Time-Scaling Algorithm
Siddharth Mansingh, James Amarel, Ragib Arnab +10
Partial Differential Equations (PDEs) are the bedrock for modern computational sciences and engineering, and inherently computationally expensive. While PDE foundation models have…
Generalization vs. Memorization in Autoregressive Deep Learning: Or, Examining Temporal Decay of Gradient Coherence
James Amarel, Nicolas Hengartner, Robyn Miller +8
Foundation models trained as autoregressive PDE surrogates hold significant promise for accelerating scientific discovery through their capacity to both extrapolate beyond training…