Foundation Neural-Networks Quantum States as a Unified Ansatz for Multiple Hamiltonians

Abstract

Foundation models are highly versatile neural-network architectures capable of processing different data types, such as text and images, and generalizing across various tasks like classification and generation. Inspired by this success, we propose Foundation Neural-Network Quantum States (FNQS) as an integrated paradigm for studying quantum many-body systems. FNQS leverage key principles of foundation models to define variational wave functions based on a single, versatile architecture that processes multimodal inputs, including spin configurations and Hamiltonian physical couplings. Unlike specialized architectures tailored for individual Hamiltonians, FNQS can generalize to physical Hamiltonians beyond those encountered during training, offering a unified framework adaptable to various quantum systems and tasks. FNQS enable the efficient estimation of quantities that are traditionally challenging or computationally intensive to calculate using conventional methods, particularly disorder-averaged observables. Furthermore, the fidelity susceptibility can be easily obtained to uncover quantum phase transitions without prior knowledge of order parameters. These pretrained models can be efficiently fine-tuned for specific quantum systems. The architectures trained in this paper are publicly available at https://huggingface.co/nqs-models, along with examples for implementing these neural networks in NetKet.

10 pages, 6 figures, 1 table

References in corpus (12)

• Learning phase transitions by confusion
• Quantum critical scaling of the geometric tensors
• Plaquette valence bond solid in the frustrated Heisenberg quantum antiferromagnet on the square lattice
• Many-Body Localization in the Age of Classical Computing
• Quantum Monte Carlo simulations of fidelity at magnetic quantum phase transitions
• A simple linear algebra identity to optimize Large-Scale Neural Network Quantum States
• Variational Monte Carlo with Large Patched Transformers
• Transformer Wave Function for two dimensional frustrated magnets: emergence of a Spin-Liquid Phase in the Shastry-Sutherland Model
• Neural network encoded variational quantum algorithms
• Tensor network study of the spin-1/2 square-lattice $J_1$-$J_2$-$J_3$ model: incommensurate spiral order, mixed valence-bond solids, and multicritical points
• Fine-tuning Neural Network Quantum States
• Quantum-critical properties of the one- and two-dimensional random transverse-field Ising model from large-scale quantum Monte Carlo simulations

Cited by in corpus (4)

• Artificial intelligence for representing and characterizing quantum systems
• Many-Body Neural Network Wavefunction for a Non-Hermitian Ising Chain
• Neural Wave Functions for High-Pressure Atomic Hydrogen
• Linear Foundation Model for Quantum Embedding: Data-Driven Compression of the Ghost Gutzwiller Variational Space