Accurate Molecular-Orbital-Based Machine Learning Energies via Unsupervised Clustering of Chemical Space

Abstract

We introduce an unsupervised clustering algorithm to improve training efficiency and accuracy in predicting energies using molecular-orbital-based machine learning (MOB-ML). This work determines clusters via the Gaussian mixture model (GMM) in an entirely automatic manner and simplifies an earlier supervised clustering approach [J. Chem. Theory Comput., 15, 6668 (2019)] by eliminating both the necessity for user-specified parameters and the training of an additional classifier. Unsupervised clustering results from GMM have the advantage of accurately reproducing chemically intuitive groupings of frontier molecular orbitals and having improved performance with an increasing number of training examples. The resulting clusters from supervised or unsupervised clustering is further combined with scalable Gaussian process regression (GPR) or linear regression (LR) to learn molecular energies accurately by generating a local regression model in each cluster. Among all four combinations of regressors and clustering methods, GMM combined with scalable exact Gaussian process regression (GMM/GPR) is the most efficient training protocol for MOB-ML. The numerical tests of molecular energy learning on thermalized datasets of drug-like molecules demonstrate the improved accuracy, transferability, and learning efficiency of GMM/GPR over not only other training protocols for MOB-ML, i.e., supervised regression-clustering combined with GPR(RC/GPR) and GPR without clustering. GMM/GPR also provide the best molecular energy predictions compared with the ones from literature on the same benchmark datasets. With a lower scaling, GMM/GPR has a 10.4-fold speedup in wall-clock training time compared with scalable exact GPR with a training size of 6500 QM7b-T molecules.

arXiv comment28 pages, 7 figures

References in corpus (24)

• Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics
• ANI-1: An extensible neural network potential with DFT accuracy at force field computational cost
• Learning to Plan Chemical Syntheses
• Molecular Graph Convolutions: Moving Beyond Fingerprints
• Quantum-Chemical Insights from Deep Tensor Neural Networks
• Deep Reinforcement Learning for De-Novo Drug Design
• By-passing the Kohn-Sham equations with machine learning
• Machine Learning Molecular Dynamics for the Simulation of Infrared Spectra
• Neural networks for the prediction organic chemistry reactions
• Hierarchical modeling of molecular energies using a deep neural network
• Electronic Spectra from TDDFT and Machine Learning in Chemical Space
• OrbNet: Deep Learning for Quantum Chemistry Using Symmetry-Adapted Atomic-Orbital Features
• Transferability in Machine Learning for Electronic Structure via the Molecular Orbital Basis
• Comparison of permutationally invariant polynomials, neural networks, and Gaussian approximation potentials in representing water interactions through many-body expansions
• Predicting molecular dipole moments by combining atomic partial charges and atomic dipoles
• Operators in Machine Learning: Response Properties in Chemical Space
• A Universal Density Matrix Functional from Molecular Orbital-Based Machine Learning: Transferability across Organic Molecules
• Gaussian approximation potential modeling of lithium intercalation in carbon nanostructures
• Ground state energy functional with Hartree-Fock efficiency and chemical accuracy
• A Fast Incremental Gaussian Mixture Model
• Regression-clustering for Improved Accuracy and Training Cost with Molecular-Orbital-Based Machine Learning
• Improved accuracy and transferability of molecular-orbital-based machine learning: Organics, transition-metal complexes, non-covalent interactions, and transition states
• Analytical Gradients for Molecular-Orbital-Based Machine Learning
• Molecular Energy Learning Using Alternative Blackbox Matrix-Matrix Multiplication Algorithm for Exact Gaussian Process

Cited by in corpus (4)

• Molecular-orbital-based Machine Learning for Open-shell and Multi-reference Systems with Kernel Addition Gaussian Process Regression
• Low-data deep quantum chemical learning for accurate MP2 and coupled-cluster correlations
• SPA${}^{\mathrm{H}}$M(a,b): encoding the density information from guess Hamiltonian in quantum machine learning representations
• Molecular Dipole Moment Learning via Rotationally Equivariant Gaussian Process Regression with Derivatives in Molecular-orbital-based Machine Learning