Molecular Dipole Moment Learning via Rotationally Equivariant Gaussian Process Regression with Derivatives in Molecular-orbital-based Machine Learning

Abstract

This study extends the accurate and transferable molecular-orbital-based machine learning (MOB-ML) approach to modeling the contribution of electron correlation to dipole moments at the cost of Hartree-Fock computations. A molecular-orbital-based (MOB) pairwise decomposition of the correlation part of the dipole moment is applied, and these pair dipole moments could be further regressed as a universal function of molecular orbitals (MOs). The dipole MOB features consist of the energy MOB features and their responses to electric fields. An interpretable and rotationally equivariant Gaussian process regression (GPR) with derivatives algorithm is introduced to learn the dipole moment more efficiently. The proposed problem setup, feature design, and ML algorithm are shown to provide highly-accurate models for both dipole moment and energies on water and fourteen small molecules. To demonstrate the ability of MOB-ML to function as generalized density-matrix functionals for molecular dipole moments and energies of organic molecules, we further apply the proposed MOB-ML approach to train and test the molecules from the QM9 dataset. The application of local scalable GPR with Gaussian mixture model unsupervised clustering (GMM/GPR) scales up MOB-ML to a large-data regime while retaining the prediction accuracy. In addition, compared with literature results, MOB-ML provides the best test MAEs of 4.21 mDebye and 0.045 kcal/mol for dipole moment and energy models, respectively, when training on 110000 QM9 molecules. The excellent transferability of the resulting QM9 models is also illustrated by the accurate predictions for four different series of peptides.

arXiv comment11 pages,6 figures

References in corpus (41)

• Gaussian Approximation Potentials: the accuracy of quantum mechanics, without the electrons
• Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
• ANI-1: An extensible neural network potential with DFT accuracy at force field computational cost
• Molecular Graph Convolutions: Moving Beyond Fingerprints
• Quantum-Chemical Insights from Deep Tensor Neural Networks
• Machine Learning of Accurate Energy-Conserving Molecular Force Fields
• Deep Reinforcement Learning for De-Novo Drug Design
• PhysNet: A Neural Network for Predicting Energies, Forces, Dipole Moments and Partial Charges
• Big Data meets Quantum Chemistry Approximations: The $\Delta$-Machine Learning Approach
• Machine Learning Unifies the Modelling of Materials and Molecules
• Deep learning for molecular design - a review of the state of the art
• By-passing the Kohn-Sham equations with machine learning
• Machine Learning of Molecular Electronic Properties in Chemical Compound Space
• Deep neural network solution of the electronic Schrödinger equation
• SchNet: A continuous-filter convolutional neural network for modeling quantum interactions
• Optimization of Molecules via Deep Reinforcement Learning
• Alchemical and structural distribution based representation for improved QML
• How accurate is density functional theory at predicting dipole moments? An assessment using a new database of 200 benchmark values
• A Transferable Machine-Learning Model of the Electron Density
• Equivariant message passing for the prediction of tensorial properties and molecular spectra
• OrbNet: Deep Learning for Quantum Chemistry Using Symmetry-Adapted Atomic-Orbital Features
• Transferability in Machine Learning for Electronic Structure via the Molecular Orbital Basis
• Accurate molecular polarizabilities with coupled-cluster theory and machine learning
• Perspective on integrating machine learning into computational chemistry and materials science
• Unsupervised machine learning in atomistic simulations, between predictions and understanding
• Comparison of permutationally invariant polynomials, neural networks, and Gaussian approximation potentials in representing water interactions through many-body expansions
• Predicting molecular dipole moments by combining atomic partial charges and atomic dipoles
• Operators in Machine Learning: Response Properties in Chemical Space
• A Universal Density Matrix Functional from Molecular Orbital-Based Machine Learning: Transferability across Organic Molecules
• OrbNet Denali: A machine learning potential for biological and organic chemistry with semi-empirical cost and DFT accuracy
• Generative Models for Automatic Chemical Design
• Gaussian approximation potential modeling of lithium intercalation in carbon nanostructures
• Ground state energy functional with Hartree-Fock efficiency and chemical accuracy
• Recognizing molecular patterns by machine learning: an agnostic structural definition of the hydrogen bond
• Regression-clustering for Improved Accuracy and Training Cost with Molecular-Orbital-Based Machine Learning
• Improved accuracy and transferability of molecular-orbital-based machine learning: Organics, transition-metal complexes, non-covalent interactions, and transition states
• Accurate Molecular-Orbital-Based Machine Learning Energies via Unsupervised Clustering of Chemical Space
• An orbital-based representation for accurate Quantum Machine Learning
• Analytical Gradients for Molecular-Orbital-Based Machine Learning
• Multi-task learning for electronic structure to predict and explore molecular potential energy surfaces
• Molecular Energy Learning Using Alternative Blackbox Matrix-Matrix Multiplication Algorithm for Exact Gaussian Process

Cited by in corpus (4)

• Predicting the Electronic Density Response of Condensed-Phase Systems to Electric Field Perturbations
• Exploring the design space of machine-learning models for quantum chemistry with a fully differentiable framework
• Molecular-orbital-based Machine Learning for Open-shell and Multi-reference Systems with Kernel Addition Gaussian Process Regression
• Machine learning of electronic structure and atomistic properties from the external potential