Discrepancies and Error Evaluation Metrics for Machine Learning Interatomic Potentials
arXiv:2306.11639 · doi:10.1038/s41524-023-01123-3
Abstract
Machine learning interatomic potentials (MLPs) are a promising technique for atomic modeling. While high accuracy and small errors are widely reported for MLPs, an open concern is whether MLPs can accurately reproduce atomistic dynamics and related physical properties in their applications in molecular dynamics (MD) simulations. In this study, we examine the current state-of-the-art MLPs and uncover a number of discrepancies related to atom dynamics, defects, and rare events (REs), in their MD simulations compared to ab initio methods. Our findings reveal that low averaged errors by current MLP testing are insufficient, leading us to develop novel quantitative metrics that better indicate the accurate prediction of related properties by MLPs in MD simulations. The MLPs optimized by the RE-based evaluation metrics are demonstrated to have improved prediction in multiple properties. The identified errors, the developed evaluation metrics, and the proposed process of developing such metrics are general to MLPs, thus providing valuable guidance for future testing, development, and improvements of accurate, robust, and reliable MLPs for atomistic modeling.
References in corpus (15)
- SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
- Gaussian Approximation Potentials: the accuracy of quantum mechanics, without the electrons
- On representing chemical environments
- Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics
- DeePMD-kit: A deep learning package for many-body potential energy representation and molecular dynamics
- A General-Purpose Machine Learning Framework for Predicting Properties of Inorganic Materials
- Moment Tensor Potentials: a class of systematically improvable interatomic potentials
- A Spectral Analysis Method for Automated Generation of Quantum-Accurate Interatomic Potentials
- A Performance and Cost Assessment of Machine Learning Interatomic Potentials
- Active learning of linearly parametrized interatomic potentials
- A learning scheme to predict atomic forces and accelerate materials simulations
- Forces are not Enough: Benchmark and Critical Evaluation for Machine Learning Force Fields with Molecular Simulations
- End-to-end Symmetry Preserving Inter-atomic Potential Energy Model for Finite and Extended Systems
- Machine-learning based interatomic potential for phonon transport in perfect crystalline Si and crystalline Si with vacancies
- Explicit Multi-element Extension of the Spectral Neighbor Analysis Potential for Chemically Complex Systems