SE(3)-equivariant prediction of molecular wavefunctions and electronic densities

Abstract

Machine learning has enabled the prediction of quantum chemical properties with high accuracy and efficiency, allowing to bypass computationally costly ab initio calculations. Instead of training on a fixed set of properties, more recent approaches attempt to learn the electronic wavefunction (or density) as a central quantity of atomistic systems, from which all other observables can be derived. This is complicated by the fact that wavefunctions transform non-trivially under molecular rotations, which makes them a challenging prediction target. To solve this issue, we introduce general SE(3)-equivariant operations and building blocks for constructing deep learning architectures for geometric point cloud data and apply them to reconstruct wavefunctions of atomistic systems with unprecedented accuracy. Our model achieves speedups of over three orders of magnitude compared to ab initio methods and reduces prediction errors by up to two orders of magnitude compared to the previous state-of-the-art. This accuracy makes it possible to derive properties such as energies and forces directly from the wavefunction in an end-to-end manner. We demonstrate the potential of our approach in a transfer learning application, where a model trained on low accuracy reference wavefunctions implicitly learns to correct for electronic many-body interactions from observables computed at a higher level of theory. Such machine-learned wavefunction surrogates pave the way towards novel semi-empirical methods, offering resolution at an electronic level while drastically decreasing computational cost. Additionally, the predicted wavefunctions can serve as initial guess in conventional ab initio methods, decreasing the number of iterations required to arrive at a converged solution, thus leading to significant speedups without any loss of accuracy or robustness.

References in corpus (10)

• Neural Message Passing for Quantum Chemistry
• Gaussian Error Linear Units (GELUs)
• On the Convergence of Adam and Beyond
• PhysNet: A Neural Network for Predicting Energies, Forces, Dipole Moments and Partial Charges
• Group Equivariant Convolutional Networks
• Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point clouds
• SpookyNet: Learning Force Fields with Electronic Degrees of Freedom and Nonlocal Effects
• Symmetry-Adapted Machine-Learning for Tensorial Properties of Atomistic Systems
• Rotation equivariant vector field networks
• Covariant Compositional Networks For Learning Graphs

Cited by in corpus (10)

• Deep-Learning Density Functional Theory Hamiltonian for Efficient ab initio Electronic-Structure Calculation
• General framework for E(3)-equivariant neural network representation of density functional theory Hamiltonian
• SchNetPack 2.0: A neural network toolbox for atomistic machine learning
• Transferable E(3) equivariant parameterization for Hamiltonian of molecules and solids
• Deep-learning electronic-structure calculation of magnetic superstructures
• Crystal Net Catalog of Model Flat Band Materials
• Equivariant analytical mapping of first principles Hamiltonians to accurate and transferable materials models
• Universal materials model of deep-learning density functional theory Hamiltonian
• Machine Learning and Data-Driven Methods in Computational Surface and Interface Science
• Fast and flexible long-range models for atomistic machine learning