All-in-one foundational models learning across quantum chemical levels
arXiv:2409.12015 · doi:10.1021/acs.jctc.5c00858
Abstract
Machine learning (ML) potentials typically target a single quantum chemical (QC) level while the ML models developed for multi-fidelity learning have not been shown to provide scalable solutions for foundational models. Here we introduce the all-in-one (AIO) ANI model architecture based on multimodal learning which can learn an arbitrary number of QC levels. Our all-in-one learning approach offers a more general and easier-to-use alternative to transfer learning. We use it to train the AIO-ANI-UIP foundational model with the generalization capability comparable to semi-empirical GFN2-xTB and DFT with a double-zeta basis set for organic molecules. We show that the AIO-ANI model can learn across different QC levels ranging from semi-empirical to density functional theory to coupled cluster. We also use AIO models to design the foundational model Δ-AIO-ANI based on Δ-learning with increased accuracy and robustness compared to AIO-ANI-UIP. The code and the foundational models are available at https://github.com/dralgroup/aio-ani; they will be integrated into the universal and updatable AI-enhanced QM (UAIQM) library and made available in the MLatom package so that they can be used online at the XACS cloud computing platform (see https://github.com/dralgroup/mlatom for updates).
References in corpus (15)
- ANI-1: An extensible neural network potential with DFT accuracy at force field computational cost
- Graph Networks as a Universal Machine Learning Framework for Molecules and Crystals
- Recent developments in the PySCF program package
- Big Data meets Quantum Chemistry Approximations: The -Machine Learning Approach
- Less is more: sampling chemical space with active learning
- Physics-inspired structural representations for molecules and materials
- ANI-1: A data set of 20M off-equilibrium DFT calculations for organic molecules
- Towards self-driving laboratories: The central role of density functional theory in the AI age
- DPA-2: a large atomic model as a multi-task learner
- Ab-initio quantum chemistry with neural-network wavefunctions
- MLatom 3: Platform for machine learning-enhanced computational chemistry simulations and workflows
- Multi-Fidelity Machine Learning for Excited State Energies of Molecules
- Spiers Memorial Lecture: How to do impactful research in artificial intelligence for chemistry and materials science
- Reducing Training Data Needs with Minimal Multilevel Machine Learning (M3L)
- Molecular Quantum Chemical Data Sets and Databases for Machine Learning Potentials