4 papers
Generalizing PDE Emulation with Equation-Aware Neural Operators
Qian-Ze Zhu, Paul Raccuglia, Michael P. Brenner
Solving partial differential equations (PDEs) can be prohibitively expensive using traditional numerical methods. Deep learning-based surrogate models typically specialize in a sin…
Expert Evaluation of LLM World Models: A High- Superconductivity Case Study
Haoyu Guo, Maria Tikhanovskaya, Paul Raccuglia +20
Large Language Models (LLMs) show great promise as a powerful tool for scientific literature exploration. However, their effectiveness in providing scientifically accurate and comp…
FEABench: Evaluating Language Models on Multiphysics Reasoning Ability
Nayantara Mudur, Hao Cui, Subhashini Venugopalan +3
Building precise simulations of the real world and invoking numerical solvers to answer quantitative problems is an essential requirement in engineering and science. We present FEA…
CURIE: Evaluating LLMs On Multitask Scientific Long Context Understanding and Reasoning
Hao Cui, Zahra Shamsi, Gowoon Cheon +31
Scientific problem-solving involves synthesizing information while applying expert knowledge. We introduce CURIE, a scientific long-Context Understanding,Reasoning and Information…