Reconstructing Kernel-based Machine Learning Force Fields with Super-linear Convergence

Abstract

Kernel machines have sustained continuous progress in the field of quantum chemistry. In particular, they have proven to be successful in the low-data regime of force field reconstruction. This is because many equivariances and invariances due to physical symmetries can be incorporated into the kernel function to compensate for much larger datasets. So far, the scalability of kernel machines has however been hindered by its quadratic memory and cubical runtime complexity in the number of training points. While it is known, that iterative Krylov subspace solvers can overcome these burdens, their convergence crucially relies on effective preconditioners, which are elusive in practice. Effective preconditioners need to partially pre-solve the learning problem in a computationally cheap and numerically robust manner. Here, we consider the broad class of Nyström-type methods to construct preconditioners based on successively more sophisticated low-rank approximations of the original kernel matrix, each of which provides a different set of computational trade-offs. All considered methods aim to identify a representative subset of inducing (kernel) columns to approximate the dominant kernel spectrum.

arXiv commentImproving readablity and presenetation of manuscript. 18 pages, 12 figures, preprint

References in corpus (20)

• Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
• E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials
• Machine Learning Force Fields
• Quantum-Chemical Insights from Deep Tensor Neural Networks
• Machine Learning of Accurate Energy-Conserving Molecular Force Fields
• PhysNet: A Neural Network for Predicting Energies, Forces, Dipole Moments and Partial Charges
• Machine learning for molecular simulation
• Combining Machine Learning and Computational Chemistry for Predictive Insights Into Chemical Systems
• Towards Exact Molecular Dynamics Simulations with Machine-Learned Force Fields
• SpookyNet: Learning Force Fields with Electronic Degrees of Freedom and Nonlocal Effects
• FCHL revisited: faster and more accurate quantum machine learning
• Alchemical and structural distribution based representation for improved QML
• Hierarchical modeling of molecular energies using a deep neural network
• sGDML: Constructing Accurate and Data Efficient Molecular Force Fields Using Machine Learning
• Accurate Interatomic Force Fields via Machine Learning with Covariant Kernels
• Accurate Force Field for Molybdenum by Machine Learning Large Materials Data
• BIGDML: Towards Exact Machine Learning Force Fields for Materials
• Permutationally invariant polynomial regression for energies and gradients, using reverse differentiation, achieves orders of magnitude speed-up with high precision compared to other machine learning methods
• Algorithmic Differentiation for Automated Modeling of Machine Learned Force Fields
• Efficient force field and energy emulation through partition of permutationally equivalent atoms