A Comprehensive Assessment and Benchmark Study of Large Atomistic Foundation Models for Phonons

Abstract

The rapid development of universal machine learning potentials (uMLPs) has enabled efficient, accurate predictions of diverse material properties across broad chemical spaces. While their capability for modeling phonon properties is emerging, systematic benchmarking across chemically diverse systems remains limited. We evaluate six recent uMLPs (EquiformerV2, MatterSim, MACE, and CHGNet) on 2,429 crystalline materials from the Open Quantum Materials Database. Models were used to compute atomic forces in displaced supercells, derive interatomic force constants (IFCs), and predict phonon properties including lattice thermal conductivity (LTC), compared with density functional theory (DFT) and experimental data. The EquiformerV2 pretrained model trained on the OMat24 dataset exhibits strong performance in predicting atomic forces and third-order IFC, while its fine-tuned counterpart consistently outperforms other models in predicting second-order IFC, LTC, and other phonon properties. Although MACE and CHGNet demonstrated comparable force prediction accuracy to EquiformerV2, notable discrepancies in IFC fitting led to poor LTC predictions. Conversely, MatterSim, despite lower force accuracy, achieved intermediate IFC predictions, suggesting error cancellation and complex relationships between force accuracy and phonon predictions. This benchmark guides the evaluation and selection of uMLPs for high-throughput screening of materials with targeted thermal transport properties.

References in corpus (14)

• Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties
• E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials
• A Universal Graph Deep Learning Interatomic Potential for the Periodic Table
• Quantum thermal transport in nanostructures
• Machine-learning interatomic potentials for materials science
• Scalable Parallel Algorithm for Graph Neural Network Interatomic Potentials in Molecular Dynamics Simulations
• MatterSim: A Deep Learning Atomistic Model Across Elements, Temperatures and Pressures
• Open Materials 2024 (OMat24) Inorganic Materials Dataset and Models
• First-Principles Prediction of Electronic Transport in Experimental Semiconductor Heterostructures via Physics-Based Machine Learning
• Learning Smooth and Expressive Interatomic Potentials for Physical Property Prediction
• Effect of the accuracy of interatomic force constants on the prediction of lattice thermal conductivity
• Machine learning for predicting ultralow thermal conductivity and high ZT in complex thermoelectric materials
• Efficient Cross-layer Thermal Transport with Atypical Glassy-like Phenomena in Crystalline CsCu${}_4$Se${}_3$
• Thermal Conductivity Predictions with Foundation Atomistic Models