Achieving fast and robust perfect entangling gates via reinforcement learning

Abstract

Noisy intermediate-scale quantum computers hold the promise of tackling complex and otherwise intractable computational challenges through the massive parallelism offered by qubits. Central to realizing the potential of quantum computing are perfect entangling (PE) two-qubit gates, which serve as a critical building block for universal quantum computation. In the context of quantum optimal control, shaping electromagnetic pulses to drive quantum gates is crucial for pushing gate performance toward theoretical limits. In this work, we leverage reinforcement learning (RL) techniques to discover near-optimal pulse shapes that yield PE gates. A collection of RL agents is trained within robust simulation environments, enabling the identification of effective control strategies even under noisy conditions. Selected agents are then validated on higher-fidelity simulations, illustrating how RL-based methods can reduce calibration overhead when compared to quantum optimal control techniques. Furthermore, the RL approach is hardware agnostic with the potential for broad applicability across various quantum computing platforms.

23 pages, 20 figures, accepted in Quantum Science and Technology

References in corpus (21)

• Simple pulses for elimination of leakage in weakly nonlinear qubits
• Quantum speed limit for non-Markovian dynamics
• Optimal Control at the Quantum Speed Limit
• Quantum speed limits in open system dynamics
• Optimal Creation of Entanglement Using a Two--Qubit Gate
• A geometric theory of non-local two-qubit operations
• Chopped random-basis quantum optimization
• Quantum limits to dynamical evolution
• A universal gate for fixed-frequency qubits via a tunable bus
• Gradient optimization of analytic controls: the route to high accuracy quantum optimal control
• Loading a Bose-Einstein Condensate onto an Optical Lattice: an Application of Optimal Control Theory to The Non Linear Schrödinger Equation
• Model-Free Quantum Control with Reinforcement Learning
• Deep Reinforcement Learning for Quantum Gate Control
• Robustness of high-fidelity Rydberg gates with single-site addressability
• Quantum Speed Limit and optimal evolution time in a two-level system
• High fidelity state preparation, quantum control, and readout of an isotopically enriched silicon spin qubit
• Realizing a deep reinforcement learning agent discovering real-time feedback control strategies for a quantum system
• Deep reinforcement learning for universal quantum state preparation via dynamic pulse control
• Optimizing quantum control pulses with complex constraints and few variables through Tensorflow
• Reinforcement learning pulses for transmon qubit entangling gates
• Analysis of lower bounds for quantum control times and their relation to the quantum speed limit