Equivariant Tensor Network Potentials

Abstract

Machine-learning interatomic potentials (MLIPs) have made a significant contribution to the recent progress in the fields of computational materials and chemistry due to the MLIPs' ability of accurately approximating energy landscapes of quantum-mechanical models while being orders of magnitude more computationally efficient. However, the computational cost and number of parameters of many state-of-the-art MLIPs increases exponentially with the number of atomic features. Tensor (non-neural) networks, based on low-rank representations of high-dimensional tensors, have been a way to reduce the number of parameters in approximating multidimensional functions, however, it is often not easy to encode the model symmetries into them. In this work we develop a formalism for rank-efficient equivariant tensor networks (ETNs), i.e. tensor networks that remain invariant under actions of SO(3) upon contraction. All the key algorithms of tensor networks like orthogonalization of cores and DMRG-based algorithms carry over to our equivariant case. Moreover, we show that many elements of modern neural network architectures like message passing, pulling, or attention mechanisms, can in some form be implemented into the ETNs. Based on ETNs, we develop a new class of polynomial-based MLIPs that demonstrate superior performance over existing MLIPs for multicomponent systems.

arXiv commentpreprint accepted for publication

References in corpus (30)

• Gaussian Approximation Potentials: the accuracy of quantum mechanics, without the electrons
• Fast and Accurate Modeling of Molecular Atomization Energies with Machine Learning
• DeePMD-kit: A deep learning package for many-body potential energy representation and molecular dynamics
• ANI-1: An extensible neural network potential with DFT accuracy at force field computational cost
• E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials
• Moment Tensor Potentials: a class of systematically improvable interatomic potentials
• Quantum-Chemical Insights from Deep Tensor Neural Networks
• A Spectral Analysis Method for Automated Generation of Quantum-Accurate Interatomic Potentials
• A Performance and Cost Assessment of Machine Learning Interatomic Potentials
• Tensor networks for complex quantum systems
• SchNet: A continuous-filter convolutional neural network for modeling quantum interactions
• Hand-waving and Interpretive Dance: An Introductory Course on Tensor Networks
• Efficient and Accurate Machine-Learning Interpolation of Atomic Energies in Compositions with Many Species
• Physically-informed artificial neural networks for atomistic modeling of materials
• Hierarchical modeling of molecular energies using a deep neural network
• MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fields
• Non-abelian symmetries in tensor networks: a quantum symmetry space approach
• Tensor Networks for Dimensionality Reduction and Large-Scale Optimizations. Part 2 Applications and Future Perspectives
• Impact of lattice relaxations on phase transitions in a high-entropy alloy studied by machine-learning potentials
• Machine-learned multi-system surrogate models for materials prediction
• Atomic cluster expansion of scalar, vectorial and tensorial properties and including magnetism and charge transfer
• TeaNet: universal neural network interatomic potential inspired by iterative electronic relaxations
• Explicit Multi-element Extension of the Spectral Neighbor Analysis Potential for Chemically Complex Systems
• Accelerating Finite-temperature Kohn-Sham Density Functional Theory with Deep Neural Networks
• Tensor-reduced atomic density representations
• Finite-temperature materials modeling from the quantum nuclei to the hot electrons regime
• Searching for iron nanoparticles with a general-purpose Gaussian approximation potential
• TensorNet: Cartesian Tensor Representations for Efficient Learning of Molecular Potentials
• On Representing (Anti)Symmetric Functions
• Functional Tensor Network Solving Many-body Schrödinger Equation

Cited by in corpus (2)

• Low-rank matrix and tensor approximations for compression of machine-learning interatomic potentials
• Exact average many-body interatomic interaction model for random alloys