Deep reinforcement learning for quantum Hamiltonian engineering

Abstract

Engineering desired Hamiltonian in quantum many-body systems is essential for applications such as quantum simulation, computation and sensing. Conventional quantum Hamiltonian engineering sequences are designed using human intuition based on perturbation theory, which may not describe the optimal solution and is unable to accommodate complex experimental imperfections. Here we numerically search for Hamiltonian engineering sequences using deep reinforcement learning (DRL) techniques and experimentally demonstrate that they outperform celebrated sequences on a solid-state nuclear magnetic resonance quantum simulator. As an example, we aim at decoupling strongly-interacting spin-1/2 systems. We train DRL agents in the presence of different experimental imperfections and verify robustness of the output sequences both in simulations and experiments. Surprisingly, many of the learned sequences exhibit a common pattern that had not been discovered before, to our knowledge, but has an meaningful analytical description. We can thus restrict the searching space based on this control pattern, allowing to search for longer sequences, ultimately leading to sequences that are robust against dominant imperfections in our experiments. Our results not only demonstrate a general method for quantum Hamiltonian engineering, but also highlight the importance of combining black-box artificial intelligence with understanding of physical system in order to realize experimentally feasible applications.

arXiv comment20 pages, 10+6 figures, 1+2 tables

References in corpus (37)

• Universal High-Frequency Behavior of Periodically Driven Systems: from Dynamical Stabilization to Floquet Engineering
• NMR Techniques for Quantum Control and Computation
• The Magnus expansion and some of its applications
• Exponentially slow heating in periodically driven many-body systems
• Optimal control technique for Many Body Quantum Systems dynamics
• Reinforcement Learning in Different Phases of Quantum Control
• Symmetrised Characterisation of Noisy Quantum Processes
• Exploring Localization in Nuclear Spin Chains
• Reinforcement Learning with Neural Networks for Quantum Feedback
• Coherence Time of a Solid-State Nuclear Qubit
• Fidelity-based Probabilistic Q-learning for Control of Quantum Systems
• Optimizing Quantum Error Correction Codes with Reinforcement Learning
• Experimental implementation of heat-bath algorithmic cooling using solid-state nuclear magnetic resonance
• When does reinforcement learning stand out in quantum control? A comparative study on state preparation
• Quantum localization bounds Trotter errors in digital quantum simulation
• Quantum Metrology with Strongly Interacting Spin Systems
• Robust Dynamic Hamiltonian Engineering of Many-Body Spin Systems
• Observation of Floquet prethermalization in dipolar spin chains
• Machine learning for long-distance quantum communication
• An information theoretical analysis of quantum optimal control
• Global optimization of quantum dynamics with AlphaZero deep exploration
• Exploring constrained quantum control landscapes
• Multi-spin dynamics of the solid-state NMR Free Induction Decay
• Automatic spin-chain learning to explore the quantum speed limit
• Emergent prethermalization signatures in out-of-time ordered correlations
• Reinforcement Learning Decoders for Fault-Tolerant Quantum Computation
• Using Recurrent Neural Networks to Optimize Dynamical Decoupling for Quantum Memory
• Measurement-based adaptation protocol with quantum reinforcement learning
• Decay of highly-correlated spin states in a dipolar-coupled solid
• A Reinforcement Learning approach for Quantum State Engineering
• Improving the dynamics of quantum sensors with reinforcement learning
• Multispin correlations and pseudo-thermalization of the transient density matrix in solid-state NMR: free induction decay and magic echo
• Dynamical suppression of fluctuations in an interacting nuclear spin bath of a self-assembled quantum dot using multiple pulse nuclear magnetic resonance
• Prethermal quasiconserved observables in Floquet quantum systems
• Fidelity enhancement by logical qubit encoding
• Machine-learning based three-qubit gate for realization of a Toffoli gate with cQED-based transmon systems
• Manipulation of Spin Dynamics by Deep Reinforcement Learning Agent

Cited by in corpus (11)

• Non-Abelian Floquet Spin Liquids in a Digital Rydberg Simulator
• Realizing a deep reinforcement learning agent discovering real-time feedback control strategies for a quantum system
• Approximate Autonomous Quantum Error Correction with Reinforcement Learning
• Exploiting disorder to probe spin and energy hydrodynamics
• Higher-Order Methods for Hamiltonian Engineering Pulse Sequence Design
• Preparing Schrödinger cat states in a microwave cavity using a neural network
• Platonic dynamical decoupling sequences for interacting spin systems
• Fast quantum gate design with deep reinforcement learning using real-time feedback on readout signals
• Dynamical decoupling of interacting spins through group factorization
• Engineering Precise and Robust Effective Hamiltonians
• Coherent Generation and Protection of Anticoherent Spin States