Optimizing Quantum Error Correction Codes with Reinforcement Learning

Abstract

Quantum error correction is widely thought to be the key to fault-tolerant quantum computation. However, determining the most suited encoding for unknown error channels or specific laboratory setups is highly challenging. Here, we present a reinforcement learning framework for optimizing and fault-tolerantly adapting quantum error correction codes. We consider a reinforcement learning agent tasked with modifying a family of surface code quantum memories until a desired logical error rate is reached. Using efficient simulations with about 70 data qubits with arbitrary connectivity, we demonstrate that such a reinforcement learning agent can determine near-optimal solutions, in terms of the number of data qubits, for various error models of interest. Moreover, we show that agents trained on one setting are able to successfully transfer their experience to different settings. This ability for transfer learning showcases the inherent strengths of reinforcement learning and the applicability of our approach for optimization from off-line simulations to on-line laboratory settings.

arXiv comment21 pages, 13 figures, 1 table, updated reference list, accepted for publication in Quantum

References in corpus (54)

• Surface codes: Towards practical large-scale quantum computation
• Probing many-body dynamics on a 51-atom quantum simulator
• Logic gates at the surface code threshold: Superconducting qubits poised for fault-tolerant quantum computing
• Topological quantum memory
• Improved Simulation of Stabilizer Circuits
• Quantum Error Correction for Quantum Memories
• 14-qubit entanglement: creation and coherence
• Observation of a Many-Body Dynamical Phase Transition with a 53-Qubit Quantum Simulator
• Scalable Designs for Quasiparticle-Poisoning-Protected Topological Quantum Computation with Majorana Zero Modes
• Demonstration of Entanglement of Electrostatically Coupled Singlet-Triplet Qubits
• Discovering physical concepts with neural networks
• Codes for the Quantum Erasure Channel
• Capacities of Quantum Erasure Channels
• Observation of Entangled States of a Fully Controlled 20-Qubit System
• A quantum information processor with trapped ions
• Fault-Tolerant Error Correction with Efficient Quantum Codes
• Active learning machine learns to create new quantum experiments
• 3D integrated superconducting qubits
• Coherent Diabatic Ion Transport and Separation in a Multi-Zone Trap Array
• Fault-tolerant quantum computation with long-range correlated noise
• Reinforcement Learning with Neural Networks for Quantum Feedback
• Ultrahigh Error Threshold for Surface Codes with Biased Noise
• A Neural Decoder for Topological Codes
• Scalable ion traps for quantum information processing
• Fast simulation of stabilizer circuits using a graph state representation
• Classification of topologically protected gates for local stabilizer codes
• Machine-learning-assisted correction of correlated qubit errors in a topological code
• Efficient Computations of Encodings for Quantum Error Correction
• Decoding Small Surface Codes with Feedforward Neural Networks
• Quantum Measurements and Gates by Code Deformation
• Fault-tolerant logical gates in quantum error-correcting codes
• Iterative Optimization of Quantum Error Correcting Codes
• Deep Neural Network Probabilistic Decoder for Stabilizer Codes
• Fault-Tolerant Computing With Biased-Noise Superconducting Qubits
• Neural Belief-Propagation Decoders for Quantum Error-Correcting Codes
• Quantum error correction for the toric code using deep reinforcement learning
• Deep neural decoders for near term fault-tolerant experiments
• Advantages of versatile neural-network decoding for topological codes
• Comparing neural network based decoders for the surface code
• Fault-tolerant quantum computation versus Gaussian noise
• Neural network decoder for topological color codes with circuit level noise
• Applying quantum algorithms to constraint satisfaction problems
• Analysing correlated noise on the surface code using adaptive decoding algorithms
• Scalable Neural Network Decoders for Higher Dimensional Quantum Codes
• Quantum Error Correction via Convex Optimization
• Quantifying the effects of local many-qubit errors and non-local two-qubit errors on the surface code
• Computational speedups using small quantum devices
• Projective simulation for classical learning agents: a comprehensive investigation
• Projective simulation with generalization
• Fault-tolerant interface between quantum memories and quantum processors
• Error- and Loss-Tolerances of Surface Codes with General Lattice Structures
• Meta-learning within Projective Simulation
• Benchmarking projective simulation in navigation problems
• Robotic Playing for Hierarchical Complex Skill Learning

Cited by in corpus (79)

• Experimental quantum speed-up in reinforcement learning agents
• Artificial Intelligence and Machine Learning for Quantum Technologies
• Machine Learning for Quantum Matter
• Entangling logical qubits with lattice surgery
• Model-Free Quantum Control with Reinforcement Learning
• When does reinforcement learning stand out in quantum control? A comparative study on state preparation
• Machine learning for long-distance quantum communication
• Variational Quantum Reinforcement Learning via Evolutionary Optimization
• Quantum Machine Learning: from physics to software engineering
• Entanglement-enhanced quantum metrology: from standard quantum limit to Heisenberg limit
• Coherent Transport of Quantum States by Deep Reinforcement Learning
• Machine learning assisted quantum state estimation
• Reinforcement Learning for Many-Body Ground-State Preparation Inspired by Counterdiabatic Driving
• Measurement Based Feedback Quantum Control With Deep Reinforcement Learning for Double-well Non-linear Potential
• Learning quantum data with the quantum Earth Mover's distance
• Deep Reinforcement Learning Control of Quantum Cartpoles
• Learning models of quantum systems from experiments
• Real-Time Decoding for Fault-Tolerant Quantum Computing: Progress, Challenges and Outlook
• A Reinforcement Learning approach for Quantum State Engineering
• Quantum enhancements for deep reinforcement learning in large spaces
• Realizing a deep reinforcement learning agent discovering real-time feedback control strategies for a quantum system
• Self-Correcting Quantum Many-Body Control using Reinforcement Learning with Tensor Networks
• Predicting quantum advantage by quantum walk with convolutional neural networks
• Setting up experimental Bell test with reinforcement learning
• Neural-Network Decoders for Measurement Induced Phase Transitions
• Variational circuit compiler for quantum error correction
• Reinforcement learning for optimal error correction of toric codes
• Deep Q-learning decoder for depolarizing noise on the toric code
• Recent Advances in Deep Learning for Channel Coding: A Survey
• Photonic architecture for reinforcement learning
• Deep reinforcement learning for quantum Hamiltonian engineering
• Operationally meaningful representations of physical systems in neural networks
• Quantum variational learning for quantum error-correcting codes
• Neural-network approach for identifying nonclassicality from click-counting data
• Simultaneous Discovery of Quantum Error Correction Codes and Encoders with a Noise-Aware Reinforcement Learning Agent
• Demonstration of a programmable optical lattice atom interferometer
• Networked Quantum Services
• Quantum reinforcement learning in continuous action space
• Deep reinforcement learning for key distribution based on quantum repeaters
• Determination of the Semion Code Threshold using Neural Decoders
• On the convergence of projective-simulation-based reinforcement learning in Markov decision processes
• Data-driven decoding of quantum error correcting codes using graph neural networks
• Detection of entangled states supported by reinforcement learning
• Hybrid discrete-continuous compilation of trapped-ion quantum circuits with deep reinforcement learning
• $i$-QER: An Intelligent Approach towards Quantum Error Reduction
• Local tensor-network codes
• Quantum error reduction with deep neural network applied at the post-processing stage
• Crosstalk Attacks and Defence in a Shared Quantum Computing Environment
• Certificates of quantum many-body properties assisted by machine learning
• Error-rate-agnostic decoding of topological stabilizer codes
• Identifying nonclassicality from experimental data using artificial neural networks
• Efficient diagnostics for quantum error correction
• FragQC: An Efficient Quantum Error Reduction Technique using Quantum Circuit Fragmentation
• Hybrid quantum-classical unsupervised data clustering based on the self-organizing feature map
• Learning Algebraic Models of Quantum Entanglement
• Neural network agent playing spin Hamiltonian games on a quantum computer
• Reinforcement Learning for Rotation Sensing with Ultracold Atoms in an Optical Lattice
• Unsupervised interpretable learning of topological indices invariant under permutations of atomic bands
• Discovery of Optimal Quantum Error Correcting Codes via Reinforcement Learning
• Quantum Circuit Discovery for Fault-Tolerant Logical State Preparation with Reinforcement Learning
• The Transfer of Entanglement Negativity at the Onset of Interactions
• Quantum error mitigation in the regime of high noise using deep neural network: Trotterized dynamics
• Improving robustness of quantum feedback control with reinforcement learning
• Recovery of Quantum Correlations using Machine Learning
• Unifying non-Markovian characterisation with an efficient and self-consistent framework
• Enhancing Quantum Memory Lifetime with Measurement-Free Local Error Correction and Reinforcement Learning
• Quantum noise modeling through Reinforcement Learning
• Statistical evaluation and optimization of entanglement purification protocols
• Accurate Unsupervised Photon Counting from Transition Edge Sensor Signals
• Quantum Compiling by Deep Reinforcement Learning
• Policy Gradient Approach to Compilation of Variational Quantum Circuits
• No-Collapse Accurate Quantum Feedback Control via Conditional State Tomography
• Optimal operation of cryogenic calorimeters through deep reinforcement learning
• Hybrid Reward-Driven Reinforcement Learning for Efficient Quantum Circuit Synthesis
• The Quantum Cartpole: A benchmark environment for non-linear reinforcement learning
• Reinforcement-learning based matterwave interferometer in a shaken optical lattice
• Learning Feedback Mechanisms for Measurement-Based Variational Quantum State Preparation
• Automated discovery and optimization of autonomous quantum error correction codes for a general open quantum system
• Unleashing Optimizations in Dynamic Circuits through Branch Expansion