Quantum Circuit Discovery for Fault-Tolerant Logical State Preparation with Reinforcement Learning

Abstract

The realization of large-scale quantum computers requires not only quantum error correction (QEC) but also fault-tolerant operations to handle errors that propagate into harmful errors. Recently, flag-based protocols have been introduced that use ancillary qubits to flag harmful errors. However, there is no clear recipe for finding a fault-tolerant quantum circuit with flag-based protocols, especially when we consider hardware constraints, such as qubit connectivity and available gate set. In this work, we propose and explore reinforcement learning (RL) to automatically discover compact and hardware-adapted fault-tolerant quantum circuits. We show that in the task of fault-tolerant logical state preparation, RL discovers circuits with fewer gates and ancillary qubits than published results without and with hardware constraints of up to 15 physical qubits. Furthermore, RL allows for straightforward exploration of different qubit connectivities and the use of transfer learning to accelerate the discovery. More generally, our work opens the door towards the use of RL for the discovery of fault-tolerant quantum circuits for addressing tasks beyond state preparation, including magic state preparation, logical gate synthesis, or syndrome measurement.

34 pages, 20 figures

References in corpus (72)

• Quantum Computing in the NISQ era and beyond
• Fault-tolerant quantum computation by anyons
• Supplementary information for "Quantum supremacy using a programmable superconducting processor"
• Surface codes: Towards practical large-scale quantum computation
• Good Quantum Error-Correcting Codes Exist
• Barren plateaus in quantum neural network training landscapes
• Improved Simulation of Stabilizer Circuits
• Multiple Particle Interference and Quantum Error Correction
• Quantum Computing with Very Noisy Devices
• Suppressing quantum errors by scaling a surface code logical qubit
• Logical quantum processor based on reconfigurable atom arrays
• Reliable Quantum Computers
• Topological Quantum Distillation
• Roads towards fault-tolerant universal quantum computation
• Real-time quantum error correction beyond break-even
• Experimental Quantum Computations on a Topologically Encoded Qubit
• t$|$ket$⟩$ : A Retargetable Compiler for NISQ Devices
• Stim: a fast stabilizer circuit simulator
• Overhead and noise threshold of fault-tolerant quantum error correction
• Resilient Quantum Computation: Error Models and Thresholds
• Realization of an Error-Correcting Surface Code with Superconducting Qubits
• Active stabilisation, quantum computation and quantum state synthesis
• Demonstration of fault-tolerant universal quantum gate operations
• Reinforcement Learning in Different Phases of Quantum Control
• Low-distance Surface Codes under Realistic Quantum Noise
• Fault-tolerant operation of a logical qubit in a diamond quantum processor
• Reinforcement Learning with Neural Networks for Quantum Feedback
• Quantum error correction with only two extra qubits
• Topological and subsystem codes on low-degree graphs with flag qubits
• Fault-tolerant conversion between the Steane and Reed-Muller quantum codes
• Artificial Intelligence and Machine Learning for Quantum Technologies
• Optimizing Quantum Error Correction Codes with Reinforcement Learning
• Flag fault-tolerant error correction with arbitrary distance codes
• Model-Free Quantum Control with Reinforcement Learning
• When does reinforcement learning stand out in quantum control? A comparative study on state preparation
• Encoding a magic state with beyond break-even fidelity
• Topological Quantum Compiling with Reinforcement Learning
• Quantum error correction for the toric code using deep reinforcement learning
• Triangular color codes on trivalent graphs with flag qubits
• Overcoming leakage in scalable quantum error correction
• Flag fault-tolerant error correction for any stabilizer code
• Fault-tolerant magic state preparation with flag qubits
• Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements
• Reinforcement Learning Decoders for Fault-Tolerant Quantum Computation
• Very low overhead fault-tolerant magic state preparation using redundant ancilla encoding and flag qubits
• Demonstration of fault-tolerant Steane quantum error correction
• A Reinforcement Learning approach for Quantum State Engineering
• Variational quantum compiling with double Q-learning
• Measurement-free fault-tolerant quantum error correction in near-term devices
• Generalized Concatenated Quantum Codes
• Classifying global state preparation via deep reinforcement learning
• Variational circuit compiler for quantum error correction
• Computational Capabilities and Compiler Development for Neutral Atom Quantum Processors: Connecting Tool Developers and Hardware Experts
• Optimization of Clifford Circuits
• Fault-Tolerant One-Bit Addition with the Smallest Interesting Colour Code
• Quantum Circuit Compiler for a Shuttling-Based Trapped-Ion Quantum Computer
• Creating entangled logical qubits in the heavy-hex lattice with topological codes
• Strategies for practical advantage of fault-tolerant circuit design in noisy trapped-ion quantum computers
• Fault-Tolerant Code Switching Protocols for Near-Term Quantum Processors
• Loss-tolerant all-photonic quantum repeater with generalized Shor code
• 6-qubit Optimal Clifford Circuits
• Demonstration of Shor encoding on a trapped-ion quantum computer
• Logical Clifford Synthesis for Stabilizer Codes
• Scalable characterization of localizable entanglement in noisy topological quantum codes
• Experiments with the 4D Surface Code on a QCCD Quantum Computer
• Measurement-free fault-tolerant logical zero-state encoding of the distance-three nine-qubit surface code in a one-dimensional qubit array
• Decoding Merged Color-Surface Codes and Finding Fault-Tolerant Clifford Circuits Using Solvers for Satisfiability Modulo Theories
• Deep reinforcement learning for preparation of thermal and prethermal quantum states
• Systematic Design and Optimization of Quantum Circuits for Stabilizer Codes
• Reinforcement Learning Generation of 4-Qubits Entangled States
• Evolving Quantum Circuits
• Weighted Quantum Channel Compiling through Proximal Policy Optimization

Cited by in corpus (1)

• Experimental measurement and a physical interpretation of quantum shadow enumerators