E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials

Abstract

This work presents Neural Equivariant Interatomic Potentials (NequIP), an E(3)-equivariant neural network approach for learning interatomic potentials from ab-initio calculations for molecular dynamics simulations. While most contemporary symmetry-aware models use invariant convolutions and only act on scalars, NequIP employs E(3)-equivariant convolutions for interactions of geometric tensors, resulting in a more information-rich and faithful representation of atomic environments. The method achieves state-of-the-art accuracy on a challenging and diverse set of molecules and materials while exhibiting remarkable data efficiency. NequIP outperforms existing models with up to three orders of magnitude fewer training data, challenging the widely held belief that deep neural networks require massive training sets. The high data efficiency of the method allows for the construction of accurate potentials using high-order quantum chemical level of theory as reference and enables high-fidelity molecular dynamics simulations over long time scales.

References in corpus (13)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• ANI-1: An extensible neural network potential with DFT accuracy at force field computational cost
• E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials
• On the Convergence of Adam and Beyond
• A Spectral Analysis Method for Automated Generation of Quantum-Accurate Interatomic Potentials
• SchNet: A continuous-filter convolutional neural network for modeling quantum interactions
• Deep Learning Scaling is Predictable, Empirically
• Directional Message Passing for Molecular Graphs
• SpookyNet: Learning Force Fields with Electronic Degrees of Freedom and Nonlocal Effects
• Equivariant message passing for the prediction of tensorial properties and molecular spectra
• GemNet: Universal Directional Graph Neural Networks for Molecules
• Accurate and scalable multi-element graph neural network force field and molecular dynamics with direct force architecture
• Geometric Prediction: Moving Beyond Scalars

Cited by in corpus (261)

• E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentials
• DeePMD-kit v2: A software package for Deep Potential models
• SpookyNet: Learning Force Fields with Electronic Degrees of Freedom and Nonlocal Effects
• A Comprehensive Survey on Deep Graph Representation Learning
• The Open Catalyst 2022 (OC22) Dataset and Challenges for Oxide Electrocatalysts
• Scalable Parallel Algorithm for Graph Neural Network Interatomic Potentials in Molecular Dynamics Simulations
• 14 Examples of How LLMs Can Transform Materials Science and Chemistry: A Reflection on a Large Language Model Hackathon
• Unifying the design space and optimizing linear and nonlinear truss metamaterials by generative modeling
• A practical guide to machine learning interatomic potentials -- Status and future
• General-purpose machine-learned potential for 16 elemental metals and their alloys
• Inverse design of 3d molecular structures with conditional generative neural networks
• Evaluation of the MACE Force Field Architecture: from Medicinal Chemistry to Materials Science
• Neural Network Potentials for Chemistry: Concepts, Applications and Prospects
• DPA-2: a large atomic model as a multi-task learner
• Ab-initio quantum chemistry with neural-network wavefunctions
• How to validate machine-learned interatomic potentials
• General framework for E(3)-equivariant neural network representation of density functional theory Hamiltonian
• Unified Graph Neural Network Force-field for the Periodic Table
• TeaNet: universal neural network interatomic potential inspired by iterative electronic relaxations
• Performance Assessment of Universal Machine Learning Interatomic Potentials: Challenges and Directions for Materials' Surfaces
• Current and future directions in network biology
• Advances of Machine Learning in Materials Science: Ideas and Techniques
• End-to-End Differentiable Molecular Mechanics Force Field Construction
• Informing Geometric Deep Learning with Electronic Interactions to Accelerate Quantum Chemistry
• DeePMD-kit v3: A Multiple-Backend Framework for Machine Learning Potentials
• Single-model uncertainty quantification in neural network potentials does not consistently outperform model ensembles
• SchNetPack 2.0: A neural network toolbox for atomistic machine learning
• Transferable E(3) equivariant parameterization for Hamiltonian of molecules and solids
• Tutorial: How to Train a Neural Network Potential
• Thermodynamics and dielectric response of ${\text{BaTiO}}_3$ by data-driven modeling
• Fast Uncertainty Estimates in Deep Learning Interatomic Potentials
• AI-driven inverse design of materials: Past, present and future
• Deep learning generative model for crystal structure prediction
• Universal Machine Learning for the Response of Atomistic Systems to External Fields
• Equivariant graph neural networks for fast electron density estimation of molecules, liquids, and solids
• i-PI 3.0: a flexible and efficient framework for advanced atomistic simulations
• The Evolution of Machine Learning Potentials for Molecules, Reactions and Materials
• Deep-learning electronic-structure calculation of magnetic superstructures
• Accelerating CALPHAD-based Phase Diagram Predictions in Complex Alloys Using Universal Machine Learning Potentials: Opportunities and Challenges
• Machine learning accelerated discovery of corrosion-resistant high-entropy alloys
• Deep-learning density functional perturbation theory
• TorchMD-Net 2.0: Fast Neural Network Potentials for Molecular Simulations
• Deep Ensembles vs. Committees for Uncertainty Estimation in Neural-Network Force Fields: Comparison and Application to Active Learning
• Neural functional theory for inhomogeneous fluids: Fundamentals and applications
• Inverse Design of Next-generation Superconductors Using Data-driven Deep Generative Models
• Spin-Dependent Graph Neural Network Potential for Magnetic Materials
• Uncertainty-biased molecular dynamics for learning uniformly accurate interatomic potentials
• Spectroscopy from Machine Learning by Accurately Representing the Atomic Polar Tensor
• High-accuracy thermodynamic properties to the melting point from ab initio calculations aided by machine-learning potentials
• Deep Coarse-grained Potentials via Relative Entropy Minimization
• Accurate machine learning force fields via experimental and simulation data fusion
• Force-Field-Enhanced Neural Network Interactions: from Local Equivariant Embedding to Atom-in-Molecule properties and long-range effects
• A reactive neural network framework for water-loaded acidic zeolites
• Point-particle drag, lift, and torque closure models using machine learning: hierarchical approach and interpretability
• Towards Linearly Scaling and Chemically Accurate Global Machine Learning Force Fields for Large Molecules
• Overcoming the Barrier of Orbital-Free Density Functional Theory for Molecular Systems Using Deep Learning
• Tensor-reduced atomic density representations
• Recent progress in the JARVIS infrastructure for next-generation data-driven materials design
• Machine Learning - Driven Materials Discovery: Unlocking Next-Generation Functional Materials - A review
• Machine Learning Potential for Electrochemical Interfaces with Hybrid Representation of Dielectric Response
• Layer-by-layer phase transformation in Ti${}_3$O${}_5$ revealed by machine learning molecular dynamics simulations
• E(n)-Equivariant Cartesian Tensor Passing Potential
• An equivariant graph neural network for the elasticity tensors of all seven crystal systems
• ArcaNN: automated enhanced sampling generation of training sets for chemically reactive machine learning interatomic potentials
• Robustness of Local Predictions in Atomistic Machine Learning Models
• Advances in modeling complex materials: The rise of neuroevolution potentials
• On the design space between molecular mechanics and machine learning force fields
• Artificial Intelligence in Materials Science and Engineering: Current Landscape, Key Challenges, and Future Trajectorie
• Multilayer atomic cluster expansion for semi-local interactions
• Grappa -- A Machine Learned Molecular Mechanics Force Field
• Model-free quantification of completeness, uncertainties, and outliers in atomistic machine learning using information theory
• Temporally coherent backmapping of molecular trajectories from coarse-grained to atomistic resolution
• High Pressure and Temperature Neural Network Reactive Force Field for Energetic Materials
• Completeness of Atomic Structure Representations
• Machine Learning and Data-Driven Methods in Computational Surface and Interface Science
• Lorentz group equivariant autoencoders
• Lightweight and Effective Tensor Sensitivity for Atomistic Neural Networks
• Denoise Pretraining on Nonequilibrium Molecules for Accurate and Transferable Neural Potentials
• Heat flux for semi-local machine-learning potentials
• Generative diffusion model for surface structure discovery
• Accelerated chemical space search using a quantum-inspired cluster expansion approach
• AI-Driven Accelerated Discovery of Intercalation-type Cathode Materials for Magnesium Batteries
• Machine Learned Interatomic Potential for Dispersion Strengthened Plasma Facing Components
• NepoIP/MM: Towards Accurate Biomolecular Simulation with a Machine Learning/Molecular Mechanics Model Incorporating Polarization Effects
• Geometry-enhanced Pre-training on Interatomic Potentials
• Accelerating the prediction of inorganic surfaces with machine learning interatomic potentials
• Reinforcement learning for traversing chemical structure space: Optimizing transition states and minimum energy paths of molecules
• Neural Network Potential with Multi-Resolution Approach Enables Accurate Prediction of Reaction Free Energies in Solution
• 3DReact: Geometric deep learning for chemical reactions
• Accelerating discrete dislocation dynamics simulations with graph neural networks
• Kernel based quantum machine learning at record rate : Many-body distribution functionals as compact representations
• Why neural functionals suit statistical mechanics
• Machine-Learning Interatomic Potentials for Long-Range Systems
• Surrogate- and invariance-boosted contrastive learning for data-scarce applications in science
• Data efficiency and extrapolation trends in neural network interatomic potentials
• chemtrain: Learning Deep Potential Models via Automatic Differentiation and Statistical Physics
• Ab Initio Generalized Langevin Equation
• Constructing and evaluating machine-learned interatomic potentials for Li-based disordered rocksalts
• Accurate quantum Monte Carlo forces for machine-learned force fields: Ethanol as a benchmark
• MGNN: Moment Graph Neural Network for Universal Molecular Potentials
• Intramolecular and water mediated tautomerism of solvated glycine
• Accelerating QM/MM simulations of electrochemical interfaces through machine learning of electronic charge densities
• Stress and heat flux via automatic differentiation
• Reducing the cost of neural network potential generation for reactive molecular systems
• Optimal pre-train/fine-tune strategies for accurate material property predictions
• Analyzing Atomic Interactions in Molecules as Learned by Neural Networks
• Approximately Equivariant Quantum Neural Network for $p4m$ Group Symmetries in Images
• Machine-Learned Atomic Cluster Expansion Potentials for Fast and Quantum-Accurate Thermal Simulations of Wurtzite AlN
• Predicting ionic conductivity in solids from the machine-learned potential energy landscape
• Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systems
• Advancing Molecular Machine Learning Representations with Stereoelectronics-Infused Molecular Graphs
• FeNNol: an Efficient and Flexible Library for Building Force-field-enhanced Neural Network Potentials
• Unified Deep Learning Framework for Many-Body Quantum Chemistry via Green's Functions
• GPU-Accelerated Approximate Kernel Method for Quantum Machine Learning
• Random sampling versus active learning algorithms for machine learning potentials of quantum liquid water
• A collinear-spin machine learned interatomic potential for Fe${}_7$Cr${}_2$Ni alloy
• Modelling complex proton transport phenomena -- Exploring the limits of fine-tuning and transferability of foundational machine-learned force fields
• Exploring the design space of machine-learning models for quantum chemistry with a fully differentiable framework
• Exploring Li-ion Transport Properties of Li${}_3$TiCl${}_6$: A Machine Learning Molecular Dynamics Study
• Augmentation of Universal Potentials for Broad Applications
• A New Moiré Platform Based on M-Point Twisting
• Atomistic modeling of bulk and grain boundary diffusion in solid electrolyte Li${}_6$PS${}_5$Cl using machine-learning interatomic potentials
• Supervised Learning and the Finite-Temperature String Method for Computing Committor Functions and Reaction Rates
• How Graph Neural Network Interatomic Potentials Extrapolate: Role of the Message-Passing Algorithm
• Transferable empirical pseudopotenials from machine learning
• Rotation-equivariant Graph Neural Networks for Learning Glassy Liquids Representations
• Beyond MD17: the reactive xxMD dataset
• Probing the effects of broken symmetries in machine learning
• Structure discovery in Atomic Force Microscopy imaging of ice
• Machine learning and invariant theory
• General time-reversal equivariant neural network potential for magnetic materials
• Machine Learning Models Capture Plasmon Dynamics in Ag Nanoparticles
• DPmoire: A tool for constructing accurate machine learning force fields in moiré systems
• Neural Thermodynamic Integration: Free Energies from Energy-based Diffusion Models
• Direct imaging of carbohydrate stereochemistry
• Cascading symmetry constraint during machine learning-enabled structural search for sulfur induced Cu(111)-$(\sqrt{43}\times \sqrt{43})$ surface reconstruction
• Efficient mapping of phase diagrams with conditional Boltzmann Generators
• Metatensor and metatomic: foundational libraries for interoperable atomistic machine learning
• Machine learning for structure-property relationships: Scalability and limitations
• Exploration of amorphous V${}_2$O${}_5$ as cathode for magnesium batteries
• Towards Symbolic XAI -- Explanation Through Human Understandable Logical Relationships Between Features
• Size and Quality of Quantum Mechanical Data Sets for Training Neural Network Force Fields for Liquid Water
• Equivariant neural network for Green's functions of molecules and materials
• Does Hessian Data Improve the Performance of Machine Learning Potentials?
• Beyond Euclid: An Illustrated Guide to Modern Machine Learning with Geometric, Topological, and Algebraic Structures
• Iterative charge equilibration for fourth-generation high-dimensional neural network potentials
• Fitting to magnetic forces improves the reliability of magnetic Moment Tensor Potentials
• Extending the atomic decomposition and many-body representation, a chemistry-motivated monomer-centered approach for machine learning potentials
• A smooth basis for atomistic machine learning
• Machine learning frontier orbital energies of nanodiamonds
• Fast proper orthogonal descriptors for many-body interatomic potentials
• AMARO: All Heavy-Atom Transferable Neural Network Potentials of Protein Thermodynamics
• Efficient moment tensor machine-learning interatomic potential for accurate description of defects in Ni-Al Alloys
• Automated atomistic simulations of dissociated dislocations with ab initio accuracy
• $\Delta$-model correction of Foundation Model based on the models own understanding
• Equivariant Neural Networks for Spin Dynamics Simulations of Itinerant Magnets
• Beam induced heating in electron microscopy modeled with machine learning interatomic potentials
• Graph-neural-network predictions of solid-state NMR parameters from spherical tensor decomposition
• Study of vacancy ordering and the boson peak in metastable cubic Ge-Sb-Te using machine learning potentials
• A Comprehensive Assessment and Benchmark Study of Large Atomistic Foundation Models for Phonons
• Efficient ensemble uncertainty estimation in Gaussian Processes Regression
• Phase stability in the Hf-N and Zr-N systems
• Equivariant Machine Learning Interatomic Potentials with Global Charge Redistribution
• Investigating Ionic Diffusivity in Amorphous Solid Electrolytes using Machine Learned Interatomic Potentials
• Efficient Generation of Stable Linear Machine-Learning Force Fields with Uncertainty-Aware Active Learning
• Crystal structure prediction with host-guided inpainting generation and foundation potentials
• Scaling Graph Neural Networks to Large Proteins
• Molecular relaxation by reverse diffusion with time step prediction
• Scaling Molecular Dynamics with ab initio Accuracy to 149 Nanoseconds per Day
• Compressing and forecasting atomic material simulations with descriptors
• Reconstructions and Dynamics of $\beta$-Lithium Thiophosphate Surfaces
• Apax: A Flexible and Performant Framework For The Development of Machine-Learned Interatomic Potentials
• On-the-fly machine learning-augmented constrained AIMD to design new routes from glassy carbon to quenchable amorphous diamond with low pressure and temperature
• A neural network potential with self-trained atomic fingerprints: a test with the mW water potential
• Superconductor discovery in the emerging paradigm of Materials Informatics
• Kapitza stabilization of quantum critical order
• Efficient dataset generation for machine learning perovskite alloys
• EOSnet: Embedded Overlap Structures for Graph Neural Networks in Predicting Material Properties
• A Planning-and-Exploring Approach to Extreme-Mechanics Force Fields
• Application-specific machine-learned interatomic potentials: exploring the trade-off between DFT convergence, MLIP expressivity, and computational cost
• Thermal Conductivity Calculation using Homogeneous Non-equilibrium Molecular Dynamics Simulation with Allegro
• Atomistic Simulations of Oxide-Water Interfaces using Machine Learning Potentials
• Rapidly Encoding Generalizable Dynamics in a Euclidean Symmetric Neural Network
• Equivariant Tensor Network Potentials
• Identifying Split Vacancy Defects with Machine-Learned Foundation Models and Electrostatics
• Accelerated lignocellulosic molecule adsorption structure determination
• Fine-Tuning Unifies Foundational Machine-learned Interatomic Potential Architectures at ab initio Accuracy
• Trade-off between Gradient Measurement Efficiency and Expressivity in Deep Quantum Neural Networks
• Accelerating structure search using atomistic graph-based classifiers
• Modeling Chemical Exfoliation of Non-van der Waals Chromium Sulfides by Machine Learning Interatomic Potentials and Monte Carlo Simulations
• High-Accuracy Physical Property Prediction for Organics via Molecular Representation Learning: Bridging Data to Discovery
• Energy-GNoME: A Living Database of Selected Materials for Energy Applications
• Multi-head committees enable direct uncertainty prediction for atomistic foundation models
• Hydrogen liquid-liquid transition from first principles and machine learning
• Evaluating the Transferability of Machine-Learned Force Fields for Material Property Modeling
• Deriving effective electrode-ion interactions from free-energy profiles at electrochemical interfaces
• Unveiling the Lithium-Ion Transport Mechanism in Li2ZrCl6 Solid-State Electrolyte via Deep Learning-Accelerated Molecular Dynamics Simulations
• Equivariant Electronic Hamiltonian Prediction with Many-Body Message Passing
• Self-learning Monte Carlo with equivariant Transformer
• Free energy profiles for chemical reactions in solution from high-dimensional neural network potentials: The case of the Strecker synthesis
• Automated Machine Learning Pipeline: Large Language Models-Assisted Automated Dataset Generation for Training Machine-Learned Interatomic Potentials
• Machine learning interatomic potential for the low-modulus Ti-Nb-Zr alloys in the vicinity of dynamical instability
• HEroBM: a deep equivariant graph neural network for universal backmapping from coarse-grained to all-atom representations
• Modeling phase transformations in Mn-rich disordered rocksalt cathodes with machine learning interatomic potentials
• Low-rank matrix and tensor approximations for compression of machine-learning interatomic potentials
• Strength of 2D Glasses Explored by Machine-Learning Force Fields
• A Data-Driven Approach to Coarse-Graining Simple Liquids in Confinement
• Teaching oxidation states to neural networks
• Intermediates of Forming Transition Metal Dichalcogenide Heterostructures Revealed by Machine Learning Simulations
• Energy-Based Coarse-Graining in Molecular Dynamics: A Flow-Based Framework without Data
• Data Fusion of Deep Learned Molecular Embeddings for Property Prediction
• Noise Tolerant Force Calculations in Density Functional Theory: A Surface Integral Approach for Wavelet-Based Methods
• A Generative Diffusion Model for Amorphous Materials
• Zero Shot Molecular Generation via Similarity Kernels
• Extreme anharmonicity and thermal contraction of 1D wires
• Tokenization for Molecular Foundation Models
• Accurate Machine Learning Interatomic Potentials for Polyacene Molecular Crystals: Application to Single Molecule Host-Guest Systems
• Learning atomic forces from uncertainty-calibrated adversarial attacks
• Efficient Learning of Long-Range and Equivariant Quantum Systems
• Towards Improved Quantum Machine Learning for Molecular Force Fields
• Machine-Learned Potentials for Solvation Modeling
• Deep-learning atomistic semi-empirical pseudopotential model for nanomaterials
• Probing the Temporal Response of Liquid Water to a THz Pump Pulse Using Machine Learning-Accelerated Non-Equilibrium Molecular Dynamics
• Machine-Learned Bond-Order Potential for Exploring the Configuration Space of Carbon
• Considerations in the use of ML interaction potentials for free energy calculations
• FIRE-GNN: Force-informed, Relaxed Equivariance Graph Neural Network for Rapid and Accurate Prediction of Surface Properties
• "One defect, one potential" strategy for accurate machine learning prediction of defect phonons
• Reconstructing Kernel-based Machine Learning Force Fields with Super-linear Convergence
• Self-supervised Representations and Node Embedding Graph Neural Networks for Accurate and Multi-scale Analysis of Materials
• FastCHGNet: Training one Universal Interatomic Potential to 1.5 Hours with 32 GPUs
• Reinforcement Fine-Tuning for Materials Design
• Modular hybrid machine learning and physics-based potentials for scalable modeling of van der Waals heterostructures
• Cation Dominated but Negatively Charged Na2SO4,aq-Graphene Interfaces
• Scalable Training of Neural Network Potentials for Complex Interfaces Through Data Augmentation
• General Learning of the Electric Response of Inorganic Materials
• Machine-learning force-field models for dynamical simulations of metallic magnets
• Active Δ-learning with universal potentials for global structure optimization
• Multi-resolution Physics-Aware Recurrent Convolutional Neural Network for Complex Flows
• Exact average many-body interatomic interaction model for random alloys
• Representing spherical tensors with scalar-based machine-learning models
• Crystal Nucleation in Eutectic Al-Si Alloys by Machine-Learned Molecular Dynamics
• Convergence of Body-Orders in Linear Atomic Cluster Expansions
• Artificial Intelligence for Direct Prediction of Molecular Dynamics Across Chemical Space
• Decoding lithium's subtle phase stability with a machine learning force field
• Self-consistency error correction for accurate machine learning potentials from variational Monte Carlo
• Multi-objective optimization and quantum hybridization of equivariant deep learning interatomic potentials
• Algebras of actions in an agent's representations of the world
• Active Learning of a Neural Network Potential for Large-Scale Atomistic Simulations of Polymer Electrolyte Membranes
• XMCQDPT2-Fidelity Transfer-Learning Potentials and a Wavepacket Oscillation Model with Power-Law Decay for Ultrafast Photodynamics
• Gradient-based grand canonical optimization enabled by graph neural networks with fractional atomic existence
• Knowledge Distillation of a Protein Language Model Yields a Foundational Implicit Solvent Model
• Machine learning of electronic structure and atomistic properties from the external potential
• Compressing local atomic neighbourhood descriptors
• Assessing zero-shot generalisation behaviour in graph-neural-network interatomic potentials
• GEWUM: General Exploration Workflow for the Utopia of Materials: A Unified Platform for Automated Structure Generation, Selection, and Validation
• Irregular Metamaterial Networks
• A flexible kinetic Monte Carlo framework for GaN molecular beam epitaxy with adaptive on-the-fly barrier evaluation
• Inverse design of bespoke interatomic potentials via active learning by information-matching
• Neural Polarization: Toward Electron Density for Molecules by Extending Equivariant Networks
• Machine-learning modeling of magnetization dynamics in quasi-equilibrium and driven metallic spin systems
• Score-based diffusion models for accurate crystal-structure inpainting and reconstruction of hydrogen positions