Fast quantum gate design with deep reinforcement learning using real-time feedback on readout signals
arXiv:2305.01169 · doi:10.1109/QCE57702.2023.00146
Abstract
The design of high-fidelity quantum gates is difficult because it requires the optimization of two competing effects, namely maximizing gate speed and minimizing leakage out of the qubit subspace. We propose a deep reinforcement learning algorithm that uses two agents to address the speed and leakage challenges simultaneously. The first agent constructs the qubit in-phase control pulse using a policy learned from rewards that compensate short gate times. The rewards are obtained at intermediate time steps throughout the construction of a full-length pulse, allowing the agent to explore the landscape of shorter pulses. The second agent determines an out-of-phase pulse to target leakage. Both agents are trained on real-time data from noisy hardware, thus providing model-free gate design that adapts to unpredictable hardware noise. To reduce the effect of measurement classification errors, the agents are trained directly on the readout signal from probing the qubit. We present proof-of-concept experiments by designing X and square root of X gates of various durations on IBM hardware. After just 200 training iterations, our algorithm is able to construct novel control pulses up to two times faster than the default IBM gates, while matching their performance in terms of state fidelity and leakage rate. As the length of our custom control pulses increases, they begin to outperform the default gates. Improvements to the speed and fidelity of gate operations open the way for higher circuit depth in quantum simulation, quantum chemistry and other algorithms on near-term and future quantum devices.
9 pages, 3 figures, submitted to QCE23: 2023 IEEE International Conference on Quantum Computing & Engineering
References in corpus (20)
- Charge insensitive qubit design derived from the Cooper pair box
- Simple pulses for elimination of leakage in weakly nonlinear qubits
- Quantum computing with neutral atoms
- Microwave-induced coupling of superconducting qubits
- Machine learning for discriminating quantum measurement trajectories and improving readout
- Model-Free Quantum Control with Reinforcement Learning
- Robust optimal quantum gates for Josephson charge qubits
- Removing leakage-induced correlated errors in superconducting quantum error correction
- Deep Reinforcement Learning for Quantum Gate Control
- Quantum control by von Neumann measurements
- Measurement Based Feedback Quantum Control With Deep Reinforcement Learning for Double-well Non-linear Potential
- Reinforcement Learning assisted Quantum Optimization
- Self-Correcting Quantum Many-Body Control using Reinforcement Learning with Tensor Networks
- Faster State Preparation across Quantum Phase Transition Assisted by Reinforcement Learning
- Quantum Architecture Search via Deep Reinforcement Learning
- Deep reinforcement learning for quantum Hamiltonian engineering
- Efficient and Robust Entanglement Generation with Deep Reinforcement Learning for Quantum Metrology
- Quantum Observables for continuous control of the Quantum Approximate Optimization Algorithm via Reinforcement Learning
- Manipulation of Spin Dynamics by Deep Reinforcement Learning Agent
- Curriculum-based Deep Reinforcement Learning for Quantum Control