Learning neural network potentials from experimental data via Differentiable Trajectory Reweighting

Abstract

In molecular dynamics (MD), neural network (NN) potentials trained bottom-up on quantum mechanical data have seen tremendous success recently. Top-down approaches that learn NN potentials directly from experimental data have received less attention, typically facing numerical and computational challenges when backpropagating through MD simulations. We present the Differentiable Trajectory Reweighting (DiffTRe) method, which bypasses differentiation through the MD simulation for time-independent observables. Leveraging thermodynamic perturbation theory, we avoid exploding gradients and achieve around 2 orders of magnitude speed-up in gradient computation for top-down learning. We show effectiveness of DiffTRe in learning NN potentials for an atomistic model of diamond and a coarse-grained model of water based on diverse experimental observables including thermodynamic, structural and mechanical properties. Importantly, DiffTRe also generalizes bottom-up structural coarse-graining methods such as iterative Boltzmann inversion to arbitrary potentials. The presented method constitutes an important milestone towards enriching NN potentials with experimental data, particularly when accurate bottom-up data is unavailable.

arXiv commentThis is a post-peer-review, pre-copyedit version of an article published in Nature Communications. The final authenticated version is available online at: http://dx.doi.org/10.1038/s41467-021-27241-4

References in corpus (21)

• Neural Message Passing for Quantum Chemistry
• Quantum-Chemical Insights from Deep Tensor Neural Networks
• Machine learning for molecular simulation
• Perspective: How good is DFT for water?
• Machine learning prediction errors better than DFT accuracy
• A Fourth-Generation High-Dimensional Neural Network Potential with Accurate Electrostatics Including Non-local Charge Transfer
• Active Learning of Uniformly Accurate Inter-atomic Potentials for Materials Simulation
• The Individual and Collective Effects of Exact Exchange and Dispersion Interactions on the Ab Initio Structure of Liquid Water
• OrbNet: Deep Learning for Quantum Chemistry Using Symmetry-Adapted Atomic-Orbital Features
• TorchMD: A deep learning framework for molecular simulations
• Coarse Graining Molecular Dynamics with Graph Neural Networks
• DeePCG: constructing coarse-grained models via deep neural networks
• A Differentiable Programming System to Bridge Machine Learning and Scientific Computing
• Modeling Diffusive Dynamics in Adaptive Resolution Simulation of Liquid Water
• Differentiable sampling of molecular geometries with uncertainty-based adversarial attacks
• Towards empirical force fields that match experimental observables
• Dynamical Strengthening of Covalent and Non-Covalent Molecular Interactions by Nuclear Quantum Effects at Finite Temperature
• A differentiable programming method for quantum control
• Understanding three-body contributions to coarse-grained force-fields
• Learning to Control PDEs with Differentiable Physics
• Differentiable Molecular Simulations for Control and Learning

Cited by in corpus (3)

• Machine Learning Coarse-Grained Potentials of Protein Thermodynamics
• Deep Coarse-grained Potentials via Relative Entropy Minimization
• Learning Pair Potentials using Differentiable Simulations