Self-Correcting Quantum Many-Body Control using Reinforcement Learning with Tensor Networks

Abstract

Quantum many-body control is a central milestone en route to harnessing quantum technologies. However, the exponential growth of the Hilbert space dimension with the number of qubits makes it challenging to classically simulate quantum many-body systems and consequently, to devise reliable and robust optimal control protocols. Here, we present a novel framework for efficiently controlling quantum many-body systems based on reinforcement learning (RL). We tackle the quantum control problem by leveraging matrix product states (i) for representing the many-body state and, (ii) as part of the trainable machine learning architecture for our RL agent. The framework is applied to prepare ground states of the quantum Ising chain, including states in the critical region. It allows us to control systems far larger than neural-network-only architectures permit, while retaining the advantages of deep learning algorithms, such as generalizability and trainable robustness to noise. In particular, we demonstrate that RL agents are capable of finding universal controls, of learning how to optimally steer previously unseen many-body states, and of adapting control protocols on-the-fly when the quantum dynamics is subject to stochastic perturbations. Furthermore, we map the QMPS framework to a hybrid quantum-classical algorithm that can be performed on noisy intermediate-scale quantum devices and test it under the presence of experimentally relevant sources of noise.

arXiv comment12 pages, 7 figures. App: 18 pages, 18 figures. 3 anc video files. New content: QMPS circuit framework for NISQ devices, novel MPO-based architecture, detailed analysis of effects of noise, etc

References in corpus (66)

• Quantum Computing in the NISQ era and beyond
• The density-matrix renormalization group in the age of matrix product states
• Hardware-efficient Variational Quantum Eigensolver for Small Molecules and Quantum Magnets
• Ultracold atomic gases in optical lattices: mimicking condensed matter physics and beyond
• A Practical Introduction to Tensor Networks: Matrix Product States and Projected Entangled Pair States
• A Quantum Approximate Optimization Algorithm
• Quantum fingerprinting
• Entanglement renormalization
• Thermodynamic limit of the density matrix renormalization for the spin-1 Heisenberg chain
• An Area Law for One Dimensional Quantum Systems
• Shortcuts to adiabaticity: concepts, methods, and applications
• Quantum Phases of Matter on a 256-Atom Programmable Quantum Simulator
• Dynamics of a Quantum Phase Transition
• Efficient quantum state tomography
• Probing condensed matter physics with magnetometry based on nitrogen-vacancy centres in diamond
• Classical simulation of quantum many-body systems with a tree tensor network
• Entropy scaling and simulability by Matrix Product States
• Optimal control technique for Many Body Quantum Systems dynamics
• Towards Quantum Machine Learning with Tensor Networks
• Quantum simulation of time-dependent Hamiltonians and the convenient illusion of Hilbert space
• Efficient tomography of a quantum many-body system
• Real- and imaginary-time evolution with compressed quantum circuits
• Optimal adaptive control for quantum metrology with time-dependent Hamiltonians
• Experimental quantum speed-up in reinforcement learning agents
• Artificial Intelligence and Machine Learning for Quantum Technologies
• Quantum Digital Signatures
• Optimizing Quantum Error Correction Codes with Reinforcement Learning
• Encoding of Matrix Product States into Quantum Circuits of One- and Two-Qubit Gates
• Optimal control of complex atomic quantum systems
• Model-Free Quantum Control with Reinforcement Learning
• Simulation of Nonequilibrium Dynamics on a Quantum Computer
• Exact Ising model simulation on a quantum computer
• Parallel Quantum Simulation of Large Systems on Small Quantum Computers
• Scalable reconstruction of density matrices
• Variational Quantum Reinforcement Learning via Evolutionary Optimization
• Topological Quantum Compiling with Reinforcement Learning
• Generalizable control for quantum parameter estimation through reinforcement learning
• Quantum error correction for the toric code using deep reinforcement learning
• On Quantum Control via Encoded Dynamical Decoupling
• An end-to-end trainable hybrid classical-quantum classifier
• Quantum circuit optimization with deep reinforcement learning
• Advances in Quantum Reinforcement Learning
• Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements
• Reinforcement Learning Decoders for Fault-Tolerant Quantum Computation
• Reinforcement learning for autonomous preparation of Floquet-engineered states: Inverting the quantum Kapitza oscillator
• Glassy Phase of Optimal Quantum Control
• A Reinforcement Learning approach for Quantum State Engineering
• Quantum enhancements for deep reinforcement learning in large spaces
• Improving the dynamics of quantum sensors with reinforcement learning
• Reinforcement Learning for Digital Quantum Simulation
• Variational quantum compiling with double Q-learning
• Faster State Preparation across Quantum Phase Transition Assisted by Reinforcement Learning
• Classifying global state preparation via deep reinforcement learning
• Pareto-optimal cycles for power, efficiency and fluctuations of quantum heat engines using reinforcement learning
• Generative machine learning with tensor networks: benchmarks on near-term quantum computers
• Entanglement from tensor networks on a trapped-ion QCCD quantum computer
• Quantum imaginary time evolution steered by reinforcement learning
• Optimal steering of matrix product states and quantum many-body scars
• Deep reinforcement learning for universal quantum state preparation via dynamic pulse control
• Quantifying the efficiency of state preparation via quantum variational eigensolvers
• Hybrid quantum-classical classifier based on tensor network and variational quantum circuit
• Quantum Annealing for Neural Network optimization problems: a new approach via Tensor Network simulations
• Reinforcement Learning with Quantum Variational Circuits
• A tensor network discriminator architecture for classification of quantum data on quantum computers
• Deep learning Local Reduced Density Matrices for Many-body Hamiltonian Estimation
• Decomposition of Matrix Product States into Shallow Quantum Circuits

Cited by in corpus (17)

• Review: Quantum Metrology and Sensing with Many-Body Systems
• Artificial Intelligence for Quantum Computing
• Tensor networks for interpretable and efficient quantum-inspired machine learning
• Simultaneous Discovery of Quantum Error Correction Codes and Encoders with a Noise-Aware Reinforcement Learning Agent
• Taming quantum systems: A tutorial for using shortcuts-to-adiabaticity, quantum optimal control, and reinforcement learning
• Entanglement engineering of optomechanical systems by reinforcement learning
• Tangent space generators of matrix product states and exact Floquet quantum scars
• Controlling quantum many-body systems using reduced-order modelling
• Artificially intelligent Maxwell's demon for optimal control of open quantum systems
• Controlling nonergodicity in quantum many-body systems by reinforcement learning
• Fast quantum gate design with deep reinforcement learning using real-time feedback on readout signals
• Quantum feedback control with a transformer neural network architecture
• Reinforcement learning to learn quantum states for Heisenberg scaling accuracy
• Reinforcement Learning for Optimal Control of Spin Magnetometers
• Robust implicit quantum control of interacting spin chains
• Towards neural reinforcement learning for large deviations in nonequilibrium systems with memory
• Hybrid Reward-Driven Reinforcement Learning for Efficient Quantum Circuit Synthesis