A Universal Density Matrix Functional from Molecular Orbital-Based Machine Learning: Transferability across Organic Molecules

Abstract

We address the degree to which machine learning can be used to accurately and transferably predict post-Hartree-Fock correlation energies. Refined strategies for feature design and selection are presented, and the molecular-orbital-based machine learning (MOB-ML) method is applied to several test systems. Strikingly, for the MP2, CCSD, and CCSD(T) levels of theory, it is shown that the thermally accessible (350 K) potential energy surface for a single water molecule can be described to within 1 millihartree using a model that is trained from only a single reference calculation at a randomized geometry. To explore the breadth of chemical diversity that can be described, MOB-ML is also applied to a new dataset of thermalized (350 K) geometries of 7211 organic models with up to seven heavy atoms. In comparison with the previously reported $\Delta$-ML method, MOB-ML is shown to reach chemical accuracy with three-fold fewer training geometries. Finally, a transferability test in which models trained for seven-heavy-atom systems are used to predict energies for thirteen-heavy-atom systems reveals that MOB-ML reaches chemical accuracy with 36-fold fewer training calculations than $\Delta$-ML (140 versus 5000 training calculations).

8 pages, 3 figures

References in corpus (23)

• Scikit-learn: Machine Learning in Python
• Gaussian Approximation Potentials: the accuracy of quantum mechanics, without the electrons
• Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
• Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics
• ANI-1: An extensible neural network potential with DFT accuracy at force field computational cost
• Learning to Plan Chemical Syntheses
• Molecular Graph Convolutions: Moving Beyond Fingerprints
• Quantum-Chemical Insights from Deep Tensor Neural Networks
• Intrinsic atomic orbitals: An unbiased bridge between quantum theory and chemical concepts
• Deep Reinforcement Learning for De-Novo Drug Design
• Big Data meets Quantum Chemistry Approximations: The $\Delta$-Machine Learning Approach
• By-passing the Kohn-Sham equations with machine learning
• Machine Learning of Molecular Electronic Properties in Chemical Compound Space
• Accurate sampling using Langevin dynamics
• Neural networks for the prediction organic chemistry reactions
• Alchemical and structural distribution based representation for improved QML
• Hierarchical modeling of molecular energies using a deep neural network
• A Transferable Machine-Learning Model of the Electron Density
• Transferability in Machine Learning for Electronic Structure via the Molecular Orbital Basis
• Accurate molecular polarizabilities with coupled-cluster theory and machine learning
• Comparison of permutationally invariant polynomials, neural networks, and Gaussian approximation potentials in representing water interactions through many-body expansions
• Gaussian approximation potential modeling of lithium intercalation in carbon nanostructures
• Recognizing molecular patterns by machine learning: an agnostic structural definition of the hydrogen bond

Cited by in corpus (35)

• Machine learning for molecular simulation
• Combining Machine Learning and Computational Chemistry for Predictive Insights Into Chemical Systems
• Deep learning for molecular design - a review of the state of the art
• Physics-inspired structural representations for molecules and materials
• Ab-Initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks
• Machine learning for electronically excited states of molecules
• FCHL revisited: faster and more accurate quantum machine learning
• Autonomous discovery in the chemical sciences part I: Progress
• Embedded Atom Neural Network Potentials: Efficient and Accurate Machine Learning with a Physically Inspired Representation
• OrbNet: Deep Learning for Quantum Chemistry Using Symmetry-Adapted Atomic-Orbital Features
• Perspective on integrating machine learning into computational chemistry and materials science
• Representations of molecules and materials for interpolation of quantum-mechanical simulations via machine learning
• OrbNet Denali: A machine learning potential for biological and organic chemistry with semi-empirical cost and DFT accuracy
• Informing Geometric Deep Learning with Electronic Interactions to Accelerate Quantum Chemistry
• Strategies for the Construction of Machine-Learning Potentials for Accurate and Efficient Atomic-Scale Simulations
• DeePKS: a comprehensive data-driven approach towards chemically accurate density functional theory
• Ground state energy functional with Hartree-Fock efficiency and chemical accuracy
• Prospects of Quantum Computing for Molecular Sciences
• Regression-clustering for Improved Accuracy and Training Cost with Molecular-Orbital-Based Machine Learning
• Physically inspired deep learning of molecular excitations and photoemission spectra
• Machine learning and excited-state molecular dynamics
• Improved accuracy and transferability of molecular-orbital-based machine learning: Organics, transition-metal complexes, non-covalent interactions, and transition states
• A deep neural network for molecular wave functions in quasi-atomic minimal basis representation
• Accurate Molecular-Orbital-Based Machine Learning Energies via Unsupervised Clustering of Chemical Space
• An orbital-based representation for accurate Quantum Machine Learning
• Analytical Gradients for Molecular-Orbital-Based Machine Learning
• Mean-Field Density Matrix Decompositions
• Data-driven Refinement of Electronic Energies from Two-Electron Reduced-Density-Matrix Theory
• Molecular-orbital-based Machine Learning for Open-shell and Multi-reference Systems with Kernel Addition Gaussian Process Regression
• Low-data deep quantum chemical learning for accurate MP2 and coupled-cluster correlations
• SPA${}^{\mathrm{H}}$M(a,b): encoding the density information from guess Hamiltonian in quantum machine learning representations
• Machine learning for accuracy in density functional approximations
• Equivariant neural network for Green's functions of molecules and materials
• Molecular Dipole Moment Learning via Rotationally Equivariant Gaussian Process Regression with Derivatives in Molecular-orbital-based Machine Learning
• Electronic specific heat capacities and entropies from density matrix quantum Monte Carlo using Gaussian process regression to find gradients of noisy data