Tutorial: How to Train a Neural Network Potential

Abstract

The introduction of modern Machine Learning Potentials (MLP) has led to a paradigm change in the development of potential energy surfaces for atomistic simulations. By providing efficient access to energies and forces, they allow to perform large-scale simulations of extended systems, which are not directly accessible by demanding first-principles methods. In these simulations, MLPs can reach the accuracy of electronic structure calculations provided that they have been properly trained and validated using a suitable set of reference data. Due to their highly flexible functional form the construction of MLPs has to be done with great care. In this tutorial, we describe the necessary key steps for training reliable MLPs, from data generation via training to final validation. The procedure, which is illustrated for the example of a high-dimensional neural network potential, is general and applicable to many types of MLPs.

References in corpus (49)

• Escaping free-energy minima
• ADADELTA: An Adaptive Learning Rate Method
• Gaussian Approximation Potentials: the accuracy of quantum mechanics, without the electrons
• On representing chemical environments
• Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics
• SchNet - a deep learning architecture for molecules and materials
• ANI-1: An extensible neural network potential with DFT accuracy at force field computational cost
• Learning to Plan Chemical Syntheses
• E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials
• Moment Tensor Potentials: a class of systematically improvable interatomic potentials
• Quantum-Chemical Insights from Deep Tensor Neural Networks
• A Spectral Analysis Method for Automated Generation of Quantum-Accurate Interatomic Potentials
• PhysNet: A Neural Network for Predicting Energies, Forces, Dipole Moments and Partial Charges
• Machine learning for molecular simulation
• Big Data meets Quantum Chemistry Approximations: The $\Delta$-Machine Learning Approach
• Less is more: sampling chemical space with active learning
• Machine Learning Unifies the Modelling of Materials and Molecules
• Active learning of linearly parametrized interatomic potentials
• On-the-fly machine learning force field generation: Application to melting points
• Machine-learning based interatomic potential for amorphous carbon
• A Fourth-Generation High-Dimensional Neural Network Potential with Accurate Electrostatics Including Non-local Charge Transfer
• Active Learning of Uniformly Accurate Inter-atomic Potentials for Materials Simulation
• Materials Cloud, a platform for open computational science
• FCHL revisited: faster and more accurate quantum machine learning
• Interatomic potentials for ionic systems with density functional accuracy based on charge densities obtained by a neural network
• Automatic Selection of Atomic Fingerprints and Reference Configurations for Machine-Learning Potentials
• WACSF - Weighted Atom-Centered Symmetry Functions as Descriptors in Machine Learning Potentials
• Unified Representation of Molecules and Crystals for Machine Learning
• An Accurate and Transferable Machine Learning Potential for Carbon
• A deep potential model with long-range electrostatic interactions
• On the Completeness of Atomic Structure Representations
• Committee neural network potentials control generalization errors and enable active learning
• Non-covalent interactions across organic and biological subsets of chemical space: Physics-based potentials parametrized from machine learning
• Metrics for measuring distances in configuration spaces
• Automated Fitting of Neural Network Potentials at Coupled Cluster Accuracy: Protonated Water Clusters as Testing Ground
• How to validate machine-learned interatomic potentials
• Transferable atomic multipole machine learning models for small organic molecules
• Atomic cluster expansion of scalar, vectorial and tensorial properties and including magnetism and charge transfer
• Molecular Force Fields with Gradient-Domain Machine Learning: Construction and Application to Dynamics of Small Molecules with Coupled Cluster Forces
• High Order Path Integrals Made Easy
• Comparing the Accuracy of High-Dimensional Neural Network Potentials and the Systematic Molecular Fragmentation Method: A Benchmark Study for all-trans Alkanes
• Machine learning force fields based on local parametrization of dispersion interactions: Application to the phase diagram of C${}_{60}$
• Electronic structure of Pr${}_{1-x}$Ca${}_x$MnO${}_3$
• Insights into lithium manganese oxide-water interfaces using machine learning potentials
• Closing the gap between theory and experiment for lithium manganese oxide spinels using a high-dimensional neural network potential
• Predicting Oxidation and Spin States by High-Dimensional Neural Networks: Applications to Lithium Manganese Oxide Spinels
• A Hybrid Density Functional Theory Benchmark Study on Lithium Manganese Oxides
• High-dimensional neural network potentials for accurate vibrational frequencies: The formic acid dimer benchmark
• A Hessian-Based Assessment of Atomic Forces for Training Machine Learning Interatomic Potentials

Cited by in corpus (15)

• A practical guide to machine learning interatomic potentials -- Status and future
• Molecular dynamics simulations of heat transport using machine-learned potentials: A mini review and tutorial on GPUMD with neuroevolution potentials
• ArcaNN: automated enhanced sampling generation of training sets for chemically reactive machine learning interatomic potentials
• Advances in modeling complex materials: The rise of neuroevolution potentials
• Machine Learning and Data-Driven Methods in Computational Surface and Interface Science
• Combining the D3 dispersion correction with the neuroevolution machine-learned potential
• Random sampling versus active learning algorithms for machine learning potentials of quantum liquid water
• Physics-informed active learning for accelerating quantum chemical simulations
• Hierarchical quantum embedding by machine learning for large molecular assemblies
• Slowly Quenched, High Pressure Glassy B${}_2$O${}_3$ at DFT Accuracy
• Atomistic Simulations of Oxide-Water Interfaces using Machine Learning Potentials
• Free energy profiles for chemical reactions in solution from high-dimensional neural network potentials: The case of the Strecker synthesis
• Structural Descriptors and Information Extraction from X-ray Emission Spectra: Aqueous Sulfuric Acid
• Machine-Learned Potentials for Solvation Modeling
• Scalable Training of Neural Network Potentials for Complex Interfaces Through Data Augmentation