Controlling nonergodicity in quantum many-body systems by reinforcement learning
arXiv:2408.11989 · doi:10.1103/PhysRevResearch.7.013256
Abstract
Finding optimal control strategies to suppress quantum thermalization for arbitrarily initial states, the so-called quantum nonergodicity control, is important for quantum information science and technologies. Previous control methods largely relied on theoretical model of the target quantum system, but invertible model approximations and inaccuracies can lead to control failures. We develop a model-free and deep-reinforcement learning (DRL) framework for quantum nonergodicity control. It is a machine-learning method with the unique focus on balancing exploration and exploitation strategies to maximize the cumulative rewards so as to preserve the initial memory in the time-dependent nonergodic metrics over a long stretch of time. We use the paradigmatic one-dimensional tilted Fermi-Hubbard system to demonstrate that the DRL agent can efficiently learn the quantum many-body system solely through the interactions with the environment. The optimal policy obtained by the DRL provides broader control scenarios for managing nonergodicity in the phase diagram as compared to, e.g., the specific protocol for Wannier-Stark localization. The continuous control protocols and observations are experimentally feasible. The model-free nature of DRL and its versatile search space for control functions render promising nonergodicity control in more complex quantum many-body systems.
20 pages, 9 figures
References in corpus (69)
- Chaos and Quantum Thermalization
- Thermalization and its mechanism for generic isolated quantum systems
- Many body localization and thermalization in quantum statistical mechanics
- Many-body localization, thermalization, and entanglement
- Logic gates at the surface code threshold: Superconducting qubits poised for fault-tolerant quantum computing
- Observation of many-body localization of interacting fermions in a quasi-random optical lattice
- Simple pulses for elimination of leakage in weakly nonlinear qubits
- Qubit architecture with high coherence and fast tunable coupling
- Schrieffer-Wolff transformation for quantum many-body systems
- Many-body localization in periodically driven systems
- Quantum Many-Body Scars and Weak Breaking of Ergodicity
- Optimal control technique for Many Body Quantum Systems dynamics
- Controlling many-body dynamics with driven quantum scars in Rydberg atom arrays
- Chopped random-basis quantum optimization
- Reinforcement Learning in Different Phases of Quantum Control
- Comparing, Optimising and Benchmarking Quantum Control Algorithms in a Unifying Programming Framework
- Minimizing irreversible losses in quantum systems by local counter-diabatic driving
- Observing non-ergodicity due to kinetic constraints in tilted Fermi-Hubbard chains
- Stark many-body localization
- Quantum Many-Body Scars: A Quasiparticle Perspective
- Observation of many-body localization in a one-dimensional system with single-particle mobility edge
- From Bloch Oscillations to Many Body Localization in Clean Interacting Systems
- Leakage reduction in fast superconducting qubit gates via optimal control
- Observation of many-body scarring in a Bose--Hubbard quantum simulator
- Subdiffusion and heat transport in a tilted 2D Fermi-Hubbard system
- Collapse and revival of quantum many-body scars via Floquet engineering
- Chiral Floquet Phases of Many-body Localized Bosons
- Many body localization and thermalization: insights from the entanglement spectrum
- Quantum Many-Body Scars in Optical Lattices
- Stark many-body localization on a superconducting quantum processor
- Dynamical scar states in driven fracton systems
- One decade of quantum optimal control in the chopped random basis
- Many-body localization due to random interactions
- Many-body Hilbert space scarring on a superconducting processor
- Ultracold atoms in optical lattices with random on-site interactions
- Discrete time-crystalline order enabled by quantum many-body scars: entanglement steering via periodic driving
- Many-body localization, symmetry, and topology
- Measurement Based Feedback Quantum Control With Deep Reinforcement Learning for Double-well Non-linear Potential
- A proposal for realising quantum scars in the tilted 1D Fermi-Hubbard model
- Exact Floquet quantum many-body scars under Rydberg blockade
- Many-body localization of bosons in optical lattices
- Dynamical Freezing and Scar Points in Strongly Driven Floquet Matter: Resonance vs Emergent Conservation Laws
- Deep Reinforcement Learning Control of Quantum Cartpoles
- Fast adiabatic evolution by oscillating initial Hamiltonians
- Many-body scar state intrinsic to periodically driven system: Rigorous results
- Fermionic many-body localization for random and quasiperiodic systems in the presence of short- and long-range interactions
- Exploring Unconventional Hubbard Models with Doubly Modulated Lattice Gases
- Stability of many-body localization in Floquet systems
- Observation of Bloch Oscillations and Wannier-Stark Localization on a Superconducting Processor
- Driving quantum many-body scars in the PXP model
- Self-Correcting Quantum Many-Body Control using Reinforcement Learning with Tensor Networks
- Superadiabatic quantum state transfer in spin chains
- Many-Body Localization in System with a Completely Delocalized Single-Particle Spectrum
- Universal subdiffusion in strongly tilted many-body systems
- Emulating the one-dimensional Fermi-Hubbard model by a double chain of qubits
- Probing transport and slow relaxation in the mass-imbalanced Fermi-Hubbard model
- Optimal steering of matrix product states and quantum many-body scars
- Non-Fermi liquids from kinetic constraints in tilted optical lattices
- Localization challenges quantum chaos in the finite two-dimensional Anderson model
- Constructing quantum many-body scar Hamiltonians from Floquet automata
- Approximate Dynamics Lead to More Optimal Control: Efficient Exact Derivatives
- Deconfinement Dynamics of Fractons in Tilted Bose-Hubbard Chains
- `Muhammad Ali effect' and incoherent destruction of Wannier-Stark localization in a stochastic field
- Tunable transport in the mass-imbalanced Fermi-Hubbard model
- Irregular Bloch Zener oscillations in two-dimensional flat-band Dirac materials
- Tangent space generators of matrix product states and exact Floquet quantum scars
- Persistent Ballistic Entanglement Spreading with Optimal Control in Quantum Spin Chains
- Engineering subharmonic responses beyond prethermalization via Floquet scar states
- Robustness of the Floquet many-body localized phase in the presence of a smooth and a non-smooth drive