Deep reinforcement learning for preparation of thermal and prethermal quantum states

Abstract

We propose a method based on deep reinforcement learning that efficiently prepares a quantum many-body pure state in thermal or prethermal equilibrium. The main physical intuition underlying the method is that the information on the equilibrium states can be efficiently encoded/extracted by focusing on only a few local observables, relying on the typicality of equilibrium states. Instead of resorting to the expensive preparation protocol that adopts global features such as the quantum state fidelity, we show that the equilibrium states can be efficiently prepared only by learning the expectation values of local observables. We demonstrate our method by preparing two illustrative examples: Gibbs ensembles in non-integrable systems and generalized Gibbs ensembles in integrable systems. Pure states prepared solely from local observables are numerically shown to successfully encode the macroscopic properties of the equilibrium states. Furthermore, we find that the preparation errors, with respect to the system size, decay exponentially for Gibbs ensembles and polynomially for generalized Gibbs ensembles, which are in agreement with the finite-size fluctuation within thermodynamic ensembles. Our method paves a path toward studying the thermodynamic and statistical properties of quantum many-body systems in quantum hardware.

18 pages, 15 figures;Appendix F-I added, some additional descriptions, script & fugures improved, results unchanged

References in corpus (19)

• Quantum Computing
• Thermalization and its mechanism for generic isolated quantum systems
• QuSpin: a Python Package for Dynamics and Exact Diagonalisation of Quantum Many Body Systems part I: spin chains
• Testing whether all eigenstates obey the Eigenstate Thermalization Hypothesis
• Generalized Thermalization in an Integrable Lattice System
• Neural-Network Approach to Dissipative Quantum Many-Body Dynamics
• Variational Quantum Monte Carlo Method with a Neural-Network Ansatz for Open Quantum Systems
• Variational neural network ansatz for steady states in open quantum systems
• Constructing neural stationary states for open quantum many-body systems
• Eigenstate thermalization within isolated spin-chain systems
• Model-Free Quantum Control with Reinforcement Learning
• Relaxation and thermalization in the one-dimensional Bose-Hubbard model: A case study for the interaction quantum quench from the atomic limit
• Emergence of quasi-condensates of hard-core bosons at finite momentum
• Identifying optimal cycles in quantum thermal machines with reinforcement-learning
• Universal properties of hard-core bosons confined on one-dimensional lattices
• Measurement Based Feedback Quantum Control With Deep Reinforcement Learning for Double-well Non-linear Potential
• Free expansion of impenetrable bosons on one-dimensional optical lattices
• Relevance of the eigenstate thermalization hypothesis for thermal relaxation
• Purifying Deep Boltzmann Machines for Thermal Quantum States

Cited by in corpus (3)

• Quantum Circuit Discovery for Fault-Tolerant Logical State Preparation with Reinforcement Learning
• Improving robustness of quantum feedback control with reinforcement learning
• Enhancing Quantum Memory Lifetime with Measurement-Free Local Error Correction and Reinforcement Learning