Residuals Are Not Enough: Limits of Physics-Informed Pre-Training for Scientific Foundation Models

Amin Totounferoush, Serge Kotchourko, Michael W. Mahoney +1

Scientific foundation models (SciFMs) aim to learn generalizable representations of physical systems governed by partial differential equations (PDEs), enabling transfer across tas…