Transformer Quantum State: A Multi-Purpose Model for Quantum Many-Body Problems

Abstract

Inspired by the advancements in large language models based on transformers, we introduce the transformer quantum state (TQS): a versatile machine learning model for quantum many-body problems. In sharp contrast to Hamiltonian/task specific models, TQS can generate the entire phase diagram, predict field strengths with experimental measurements, and transfer such a knowledge to new systems it has never been trained on before, all within a single model. With specific tasks, fine-tuning the TQS produces accurate results with small computational cost. Versatile by design, TQS can be easily adapted to new tasks, thereby pointing towards a general-purpose model for various challenging quantum problems.

12 pages, 13 figures

References in corpus (3)

• The density-matrix renormalization group in the age of matrix product states
• Learning phase transitions by confusion
• Weak binding between two aromatic rings: feeling the van der Waals attraction by quantum Monte Carlo methods

Cited by in corpus (19)

• Variational Benchmarks for Quantum Many-Body Problems
• Variational Monte Carlo with Large Patched Transformers
• Adaptive Quantum State Tomography with Active Learning
• Foundation Neural-Networks Quantum States as a Unified Ansatz for Multiple Hamiltonians
• Variational optimization of the amplitude of neural-network quantum many-body ground states
• Deep learning of many-body observables and quantum information scrambling
• Transformer neural networks and quantum simulators: a hybrid approach for simulating strongly correlated systems
• Unified Quantum State Tomography and Hamiltonian Learning Using Transformer Models: A Language-Translation-Like Approach for Quantum Systems
• Autoregressive neural quantum states of Fermi Hubbard models
• Impact of conditional modelling for a universal autoregressive quantum state
• Learning the expressibility of quantum circuit ansatz using transformer
• Time-dependent Neural Galerkin Method for Quantum Dynamics
• Fluctuation based interpretable analysis scheme for quantum many-body snapshots
• Quantum feedback control with a transformer neural network architecture
• Physics-informed Transformers for Electronic Quantum States
• Attention to Quantum Complexity
• Neural network enhanced cross entropy benchmark for monitored circuits
• Variational Transformer Ansatz for the Density Operator of Steady States in Dissipative Quantum Many-Body Systems
• Neural network ensemble for computing cross sections for rotational transitions in H${}_2$O + H${}_2$O collisions