Foundation Neural-Networks Quantum States as a Unified Ansatz for Multiple Hamiltonians

Abstract

Foundation models are highly versatile neural-network architectures capable of processing different data types, such as text and images, and generalizing across various tasks like classification and generation. Inspired by this success, we propose Foundation Neural-Network Quantum States (FNQS) as an integrated paradigm for studying quantum many-body systems. FNQS leverage key principles of foundation models to define variational wave functions based on a single, versatile architecture that processes multimodal inputs, including spin configurations and Hamiltonian physical couplings. Unlike specialized architectures tailored for individual Hamiltonians, FNQS can generalize to physical Hamiltonians beyond those encountered during training, offering a unified framework adaptable to various quantum systems and tasks. FNQS enable the efficient estimation of quantities that are traditionally challenging or computationally intensive to calculate using conventional methods, particularly disorder-averaged observables. Furthermore, the fidelity susceptibility can be easily obtained to uncover quantum phase transitions without prior knowledge of order parameters. These pretrained models can be efficiently fine-tuned for specific quantum systems. The architectures trained in this paper are publicly available at https://huggingface.co/nqs-models, along with examples for implementing these neural networks in NetKet.

10 pages, 6 figures, 1 table

References in corpus (42)

• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Many-body localization, thermalization, and entanglement
• Machine learning phases of matter
• Predicting Many Properties of a Quantum System from Very Few Measurements
• Learning phase transitions by confusion
• Fidelity approach to quantum phase transitions
• Quantum critical scaling of the geometric tensors
• Ab-Initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks
• Finite-Size Scaling of the Ground State Parameters of the Two-Dimensional Heisenberg Model
• Quantum Natural Gradient
• Theory of variational quantum simulation
• Experimental realization of a 2D fractional quantum spin liquid
• Machine learning quantum phases of matter beyond the fermion sign problem
• Green Function Monte Carlo with Stochastic Reconfiguration
• Wave function optimization in the variational Monte Carlo method
• Fermionic neural-network states for ab-initio electronic structure
• Provably efficient machine learning for quantum many-body problems
• Quantum many-body dynamics in two dimensions with artificial neural networks
• A Numerical Study of the Random Transverse-Field Ising Spin Chain
• Plaquette valence bond solid in the frustrated Heisenberg quantum antiferromagnet on the square lattice
• Quantum Critical Scaling of Fidelity Susceptibility
• Direct evidence for a gapless $Z_2$ spin liquid by frustrating Néel antiferromagnetism
• Backflow Transformations via Neural Networks for Quantum Many-Body Wave-Functions
• NetKet 3: Machine Learning Toolbox for Many-Body Quantum Systems
• Many-Body Localization in the Age of Classical Computing
• Quantum Monte Carlo simulations of fidelity at magnetic quantum phase transitions
• Ab-initio quantum chemistry with neural-network wavefunctions
• Fermionic Wave Functions from Neural-Network Constrained Hidden States
• Transformer variational wave functions for frustrated quantum spin systems
• Empowering deep neural quantum states through efficient optimization
• High-accuracy variational Monte Carlo for frustrated magnets with deep neural networks
• The emergence of gapless quantum spin liquid from deconfined quantum critical point
• Transformer Quantum State: A Multi-Purpose Model for Quantum Many-Body Problems
• A simple linear algebra identity to optimize Large-Scale Neural Network Quantum States
• Fidelity susceptibility of the quantum Ising model in the transverse field: The exact solution
• Suppression of Dimer Correlations in the Two-Dimensional $J_1$-$J_2$ Heisenberg Model: an Exact Diagonalization Study
• Variational Monte Carlo with Large Patched Transformers
• Transformer Wave Function for two dimensional frustrated magnets: emergence of a Spin-Liquid Phase in the Shastry-Sutherland Model
• Neural network encoded variational quantum algorithms
• Tensor network study of the spin-1/2 square-lattice $J_1$-$J_2$-$J_3$ model: incommensurate spiral order, mixed valence-bond solids, and multicritical points
• Fine-tuning Neural Network Quantum States
• Quantum-critical properties of the one- and two-dimensional random transverse-field Ising model from large-scale quantum Monte Carlo simulations

Cited by in corpus (4)

• Artificial intelligence for representing and characterizing quantum systems
• Many-Body Neural Network Wavefunction for a Non-Hermitian Ising Chain
• Neural Wave Functions for High-Pressure Atomic Hydrogen
• Linear Foundation Model for Quantum Embedding: Data-Driven Compression of the Ghost Gutzwiller Variational Space