Deep Reinforcement Learning for Quantum Gate Control

Abstract

How to implement multi-qubit gates efficiently with high precision is essential for realizing universal fault tolerant computing. For a physical system with some external controllable parameters, it is a great challenge to control the time dependence of these parameters to achieve a target multi-qubit gate efficiently and precisely. Here we construct a dueling double deep Q-learning neural network (DDDQN) to find out the optimized time dependence of controllable parameters to implement two typical quantum gates: a single-qubit Hadamard gate and a two-qubit CNOT gate. Compared with traditional optimal control methods, this deep reinforcement learning method can realize efficient and precise gate control without requiring any gradient information during the learning process. This work attempts to pave the way to investigate more quantum control problems with deep reinforcement learning techniques.

7 pages, 6 figures

References in corpus (20)

• Quantum Machine Learning
• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Prioritized Experience Replay
• Machine learning phases of matter
• NMR Techniques for Quantum Control and Computation
• Observation of entanglement propagation in a quantum many-body system
• Quantum Computational Supremacy
• Dynamics of a Quantum Phase Transition
• Landau-Zener-Stuckelberg interferometry
• Learning phase transitions by confusion
• Digitized adiabatic quantum computing with a superconducting circuit
• Onset of a Quantum Phase Transition with a Trapped Ion Quantum Simulator
• Fast Automated Analysis of Strong Gravitational Lenses with Convolutional Neural Networks
• Accelerated quantum control using superadiabatic dynamics in a solid-state lambda system
• Optimal control, geometry, and quantum computing
• Evolutionary Algorithms for Hard Quantum Control
• Glassy Phase of Optimal Quantum Control
• Singularities of Quantum Control Landscapes
• Quantum Optimal Control: Landscape Structure and Topology
• Exploring Quantum Control Landscape Structure

Cited by in corpus (66)

• Artificial Intelligence and Machine Learning for Quantum Technologies
• Machine Learning for Quantum Matter
• High-Fidelity, Frequency-Flexible Two-Qubit Fluxonium Gates with a Transmon Coupler
• Model-Free Quantum Control with Reinforcement Learning
• Experimental Deep Reinforcement Learning for Error-Robust Gateset Design on a Superconducting Quantum Computer
• Identifying optimal cycles in quantum thermal machines with reinforcement-learning
• Generalizable control for quantum parameter estimation through reinforcement learning
• Global optimization of quantum dynamics with AlphaZero deep exploration
• Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements
• Reinforcement Learning assisted Quantum Optimization
• Deep Reinforcement Learning Control of Quantum Cartpoles
• Quantum optimal control of multi-level dissipative quantum systems with Reinforcement Learning
• Breaking Adiabatic Quantum Control with Deep Learning
• Reinforcement learning optimization of the charging of a Dicke quantum battery
• Experimental benchmarking of an automated deterministic error suppression workflow for quantum algorithms
• Quantum Architecture Search via Deep Reinforcement Learning
• Deep Reinforcement Learning for Efficient Measurement of Quantum Devices
• Classifying global state preparation via deep reinforcement learning
• Pareto-optimal cycles for power, efficiency and fluctuations of quantum heat engines using reinforcement learning
• Hessian-based optimization of constrained quantum control
• Policy Gradient based Quantum Approximate Optimization Algorithm
• Quantum imaginary time evolution steered by reinforcement learning
• Extreme Spin Squeezing from Deep Reinforcement Learning
• Quantum kernels to learn the phases of quantum matter
• Deep reinforcement learning for universal quantum state preparation via dynamic pulse control
• A quantum system control method based on enhanced reinforcement learning
• Robust Control of Quantum Dynamics under Input and Parameter Uncertainty
• Robust population inversion in three-level systems by composite pulses
• Quantum reinforcement learning in continuous action space
• Generation and storage of spin squeezing via learning-assisted optimal control
• Quantum Logic Gate Synthesis as a Markov Decision Process
• Fast, high precision dynamics in quantum optimal control theory
• Detection of entangled states supported by reinforcement learning
• Active Learning Approach to Optimization of Experimental Control
• Reinforcement learning pulses for transmon qubit entangling gates
• Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
• Ultrafast critical ground state preparation via bang-bang protocols
• Machine Learning for Estimation and Control of Quantum Systems
• Robust optimization for quantum reinforcement learning control using partial observations
• Preparing Schrödinger cat states in a microwave cavity using a neural network
• Approximations in transmon simulation
• Universal quantum state preparation via revised greedy algorithm
• TorchQC -- A framework for efficiently integrating machine and deep learning methods in quantum dynamics and control
• Fast generation of entanglement between coupled spins using optimization and deep learning methods
• Exploring the Optimal Cycle for Quantum Heat Engine using Reinforcement Learning
• Enhanced quantum state preparation via stochastic prediction of neural network
• An RNN-policy gradient approach for quantum architecture search
• Quantum optimal control in quantum technologies. Strategic report on current status, visions and goals for research in Europe
• Framework for Learning and Control in the Classical and Quantum Domains
• Neural network agent playing spin Hamiltonian games on a quantum computer
• Characterization of a driven two-level quantum system by Supervised Learning
• Dual-Capability Machine Learning Models for Quantum Hamiltonian Parameter Estimation and Dynamics Prediction
• Learning quantum phases via single-qubit disentanglement
• Artificially intelligent Maxwell's demon for optimal control of open quantum systems
• Fast quantum gate design with deep reinforcement learning using real-time feedback on readout signals
• A Quantum States Preparation Method Based on Difference-Driven Reinforcement Learning
• Dropout is all you need: robust two-qubit gate with reinforcement learning
• Supercomputer simulations of transmon quantum computers
• Deep reinforcement learning for feedback control in a collective flashing ratchet
• Adaptive Random Quantum Eigensolver
• Quantum Compiling by Deep Reinforcement Learning
• Variational quantum compiling for three-qubit gates design in quantum dots
• Achieving fast and robust perfect entangling gates via reinforcement learning
• Bounding fidelity in quantum feedback control: theory and applications to Dicke state preparation
• Active Quantum Distillation
• Approximate quantum gates compiling with self-navigation algorithm