Measurement Based Feedback Quantum Control With Deep Reinforcement Learning for Double-well Non-linear Potential

Abstract

Closed loop quantum control uses measurement to control the dynamics of a quantum system to achieve either a desired target state or target dynamics. In the case when the quantum Hamiltonian is quadratic in $x$ and $p$, there are known optimal control techniques to drive the dynamics towards particular states e.g. the ground state. However, for nonlinear Hamiltonians such control techniques often fail. We apply Deep Reinforcement Learning (DRL), where an artificial neural agent explores and learns to control the quantum evolution of a highly non-linear system (double well), driving the system towards the ground state with high fidelity. We consider a DRL strategy which is particularly motivated by experiment where the quantum system is continuously but weakly measured. This measurement is then fed back to the neural agent and used for training. We show that the DRL can effectively learn counter-intuitive strategies to cool the system to a nearly-pure `cat' state which has a high overlap fidelity with the true ground state.

5 pages, 2 figures, journal article with supplementary materials

References in corpus (6)

• A Straightforward Introduction to Continuous Quantum Measurement
• Deterministic Dicke state preparation with continuous measurement and control
• The double well potential in quantum mechanics: a simple, numerically exact formulation
• Faster State Preparation across Quantum Phase Transition Assisted by Reinforcement Learning
• Engineering Superposition States and Tailored Probes for Nano-resonators Via Open-Loop Control
• Kalman meets Bellman: Improving Policy Evaluation through Value Tracking

Cited by in corpus (37)

• Artificial Intelligence and Machine Learning for Quantum Technologies
• Model-Free Quantum Control with Reinforcement Learning
• Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements
• A Tutorial on Optimal Control and Reinforcement Learning methods for Quantum Technologies
• Approximate Autonomous Quantum Error Correction with Reinforcement Learning
• Realizing a deep reinforcement learning agent discovering real-time feedback control strategies for a quantum system
• Deep reinforcement learning for quantum multiparameter estimation
• Gradient Ascent Pulse Engineering with Feedback
• Measurement-driven navigation in many-body Hilbert space: Active-decision steering
• A pedagogical introduction to continuously monitored quantum systems and measurement-based feedback
• Detection of entangled states supported by reinforcement learning
• Hybrid discrete-continuous compilation of trapped-ion quantum circuits with deep reinforcement learning
• Robust optimization for quantum reinforcement learning control using partial observations
• Machine Learning for Estimation and Control of Quantum Systems
• Entropy Regularized Reinforcement Learning Using Large Deviation Theory
• Deep reinforcement learning for preparation of thermal and prethermal quantum states
• Preparing Schrödinger cat states in a microwave cavity using a neural network
• Accelerated Magnonic Motional Cooling with Deep Reinforcement Learning
• Designing fast quantum gates using optimal control with a reinforcement-learning ansatz
• Entanglement engineering of optomechanical systems by reinforcement learning
• Cavity-Heisenberg spin-$j$ chain quantum battery and reinforcement learning optimization
• Control landscape of measurement-assisted transition probability for a three-level quantum system with dynamical symmetry
• Characterization of a driven two-level quantum system by Supervised Learning
• Improving robustness of quantum feedback control with reinforcement learning
• Measurement based estimator scheme for continuous quantum error correction
• Machine learning for efficient generation of universal hybrid quantum computing resources
• Controlling nonergodicity in quantum many-body systems by reinforcement learning
• Fast quantum gate design with deep reinforcement learning using real-time feedback on readout signals
• Dropout is all you need: robust two-qubit gate with reinforcement learning
• Quantum feedback control with a transformer neural network architecture
• No-Collapse Accurate Quantum Feedback Control via Conditional State Tomography
• Fast State Stabilization using Deep Reinforcement Learning for Measurement-based Quantum Feedback Control
• Extracting filtered signal statistics of continuously measured quantum systems
• Feedback cooling of fermionic atoms in optical lattices
• Bounding fidelity in quantum feedback control: theory and applications to Dicke state preparation
• Learning Feedback Mechanisms for Measurement-Based Variational Quantum State Preparation
• The Quantum Cartpole: A benchmark environment for non-linear reinforcement learning