Discovery of Optimal Quantum Error Correcting Codes via Reinforcement Learning

Abstract

The recently introduced Quantum Lego framework provides a powerful method for generating complex quantum error correcting codes (QECCs) out of simple ones. We gamify this process and unlock a new avenue for code design and discovery using reinforcement learning (RL). One benefit of RL is that we can specify \textit{arbitrary} properties of the code to be optimized. We train on two such properties, maximizing the code distance, and minimizing the probability of logical error under biased Pauli noise. For the first, we show that the trained agent identifies ways to increase code distance beyond naive concatenation, saturating the linear programming bound for CSS codes on 13 qubits. With a learning objective to minimize the logical error probability under biased Pauli noise, we find the best known CSS code at this task for $\lesssim 20$ qubits. Compared to other (locally deformed) CSS codes, including Surface, XZZX, and 2D Color codes, our $[[17,1,3]]$ code construction actually has \textit{lower} adversarial distance, yet better protects the logical information, highlighting the importance of QECC desiderata. Lastly, we comment on how this RL framework can be used in conjunction with physical quantum devices to tailor a code without explicit characterization of the noise model.

arXiv comment10 pages + appendices; v2 figure updated and note added

References in corpus (21)

• Fault-tolerant quantum computation by anyons
• Improved Simulation of Stabilizer Circuits
• Holographic quantum error-correcting codes: Toy models for the bulk/boundary correspondence
• Bulk Locality and Quantum Error Correction in AdS/CFT
• Computing with spin qubits at the surface code error threshold
• The XZZX Surface Code
• Efficient Algorithms for Maximum Likelihood Decoding in the Surface Code
• Bosonic quantum error correction codes in superconducting quantum circuits
• Optimizing Quantum Error Correction Codes with Reinforcement Learning
• Model-Free Quantum Control with Reinforcement Learning
• Efficient Computations of Encodings for Quantum Error Correction
• Machine Learning in the String Landscape
• Deep Neural Network Probabilistic Decoder for Stabilizer Codes
• Reinforcement Learning Decoders for Fault-Tolerant Quantum Computation
• CSS-like Constructions of Asymmetric Quantum Codes
• Bias-tailored quantum LDPC codes
• Quantum Lego: Building Quantum Error Correction Codes from Tensor Networks
• Clifford-deformed Surface Codes
• Quantum variational learning for quantum error-correcting codes
• Local tensor-network codes
• Evolving Quantum Circuits

Cited by in corpus (5)

• Artificial Intelligence for Quantum Computing
• Tensor networks for quantum computing
• Unifying non-Markovian characterisation with an efficient and self-consistent framework
• Quantum Lego and XP Stabilizer Codes
• Automated discovery and optimization of autonomous quantum error correction codes for a general open quantum system