Deep reinforcement learning for preparation of thermal and prethermal quantum states

Abstract

We propose a method based on deep reinforcement learning that efficiently prepares a quantum many-body pure state in thermal or prethermal equilibrium. The main physical intuition underlying the method is that the information on the equilibrium states can be efficiently encoded/extracted by focusing on only a few local observables, relying on the typicality of equilibrium states. Instead of resorting to the expensive preparation protocol that adopts global features such as the quantum state fidelity, we show that the equilibrium states can be efficiently prepared only by learning the expectation values of local observables. We demonstrate our method by preparing two illustrative examples: Gibbs ensembles in non-integrable systems and generalized Gibbs ensembles in integrable systems. Pure states prepared solely from local observables are numerically shown to successfully encode the macroscopic properties of the equilibrium states. Furthermore, we find that the preparation errors, with respect to the system size, decay exponentially for Gibbs ensembles and polynomially for generalized Gibbs ensembles, which are in agreement with the finite-size fluctuation within thermodynamic ensembles. Our method paves a path toward studying the thermodynamic and statistical properties of quantum many-body systems in quantum hardware.

arXiv comment18 pages, 15 figures;Appendix F-I added, some additional descriptions, script & fugures improved, results unchanged

References in corpus (72)

• Quantum Cryptography
• Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Network
• Advances in Quantum Metrology
• Quantum Computing
• Chaos and Quantum Thermalization
• Thermalization and its mechanism for generic isolated quantum systems
• Machine learning and the physical sciences
• From Quantum Chaos and Eigenstate Thermalization to Statistical Mechanics and Thermodynamics
• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Relaxation in a Completely Integrable Many-Body Quantum System: An Ab Initio Study of the Dynamics of the Highly Excited States of Lattice Hard-Core Bosons
• Machine learning phases of matter
• Predicting Many Properties of a Quantum System from Very Few Measurements
• The foundations of statistical mechanics from entanglement: Individual states vs. averages
• A high-bias, low-variance introduction to Machine Learning for physicists
• Many-body quantum state tomography with neural networks
• Canonical Typicality
• Generalized Gibbs ensemble in integrable lattice models
• Thermalization and prethermalization in isolated quantum systems: a theoretical overview
• Complete Generalized Gibbs Ensemble in an interacting Theory
• Ab-Initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks
• QuSpin: a Python Package for Dynamics and Exact Diagonalisation of Quantum Many Body Systems part I: spin chains
• Testing whether all eigenstates obey the Eigenstate Thermalization Hypothesis
• Optimal control technique for Many Body Quantum Systems dynamics
• Chopped random-basis quantum optimization
• Generalized Thermalization in an Integrable Lattice System
• Efficient Representation of Quantum Many-body States with Deep Neural Networks
• QuSpin: a Python Package for Dynamics and Exact Diagonalisation of Quantum Many Body Systems. Part II: bosons, fermions and higher spins
• Reduced Density Matrix after a Quantum Quench
• Reconstructing quantum states with generative models
• Reinforcement Learning in Different Phases of Quantum Control
• Neural-Network Approach to Dissipative Quantum Many-Body Dynamics
• Finite-size scaling of eigenstate thermalization
• Recurrent Neural Network Wave Functions
• Deep autoregressive models for the efficient variational simulation of many-body quantum systems
• Variational Quantum Monte Carlo Method with a Neural-Network Ansatz for Open Quantum Systems
• Variational neural network ansatz for steady states in open quantum systems
• Canonical Thermal Pure Quantum State
• Reinforcement Learning with Neural Networks for Quantum Feedback
• Thermal Pure Quantum States at Finite Temperature
• Neural-Network Quantum States, String-Bond States, and Chiral Topological States
• Sampling from the thermal quantum Gibbs state and evaluating partition functions with a quantum computer
• The problem of equilibration and the computation of correlation functions on a quantum computer
• Constructing neural stationary states for open quantum many-body systems
• Eigenstate thermalization within isolated spin-chain systems
• Learning a local Hamiltonian from local measurements
• Artificial Neural Network Methods in Quantum Mechanics
• Eigenstate thermalization in the two-dimensional transverse field Ising model
• Variational Thermal Quantum Simulation via Thermofield Double States
• Latent Space Purification via Neural Density Operators
• Model-Free Quantum Control with Reinforcement Learning
• Sample-efficient learning of quantum many-body systems
• Relaxation and thermalization in the one-dimensional Bose-Hubbard model: A case study for the interaction quantum quench from the atomic limit
• Emergence of quasi-condensates of hard-core bosons at finite momentum
• Identifying optimal cycles in quantum thermal machines with reinforcement-learning
• Universal properties of hard-core bosons confined on one-dimensional lattices
• Reinforcement Learning for Many-Body Ground-State Preparation Inspired by Counterdiabatic Driving
• Measurement Based Feedback Quantum Control With Deep Reinforcement Learning for Double-well Non-linear Potential
• Learning Disordered Topological Phases by Statistical Recovery of Symmetry
• Reinforcement learning for autonomous preparation of Floquet-engineered states: Inverting the quantum Kapitza oscillator
• Deep Reinforcement Learning Control of Quantum Cartpoles
• Efficient Representation of Topologically Ordered States with Restricted Boltzmann Machines
• Free expansion of impenetrable bosons on one-dimensional optical lattices
• Numerical Large Deviation Analysis of Eigenstate Thermalization Hypothesis
• Relevance of the eigenstate thermalization hypothesis for thermal relaxation
• Reinforcement learning approach to non-equilibrium quantum thermodynamics
• Quantum optimal control of multi-level dissipative quantum systems with Reinforcement Learning
• Solving Quasiparticle Band Spectra of Real Solids using Neural-Network Quantum States
• Breaking Adiabatic Quantum Control with Deep Learning
• On the local equivalence between the canonical and the microcanonical distributions for quantum spin systems
• Purifying Deep Boltzmann Machines for Thermal Quantum States
• Compressed sensing for Hamiltonian reconstruction
• Transforming Generalized Ising Model into Boltzmann Machine

Cited by in corpus (3)

• Quantum Circuit Discovery for Fault-Tolerant Logical State Preparation with Reinforcement Learning
• Improving robustness of quantum feedback control with reinforcement learning
• Enhancing Quantum Memory Lifetime with Measurement-Free Local Error Correction and Reinforcement Learning