Unitary Synthesis of Clifford+T Circuits with Reinforcement Learning

Abstract

This paper presents a deep reinforcement learning approach for synthesizing unitaries into quantum circuits. Unitary synthesis aims to identify a quantum circuit that represents a given unitary while minimizing circuit depth, total gate count, a specific gate count, or a combination of these factors. While past research has focused predominantly on continuous gate sets, synthesizing unitaries from the parameter-free Clifford+T gate set remains a challenge. Although the time complexity of this task will inevitably remain exponential in the number of qubits for general unitaries, reducing the runtime for simple problem instances still poses a significant challenge. In this study, we apply the tree-search method Gumbel AlphaZero to solve the problem for a subset of exactly synthesizable Clifford+T unitaries. Our method effectively synthesizes circuits for up to five qubits generated from randomized circuits with up to 60 gates, outperforming existing tools like QuantumCircuitOpt and MIN-T-SYNTH in terms of synthesis time for larger qubit counts. Furthermore, it surpasses Synthetiq in successfully synthesizing random, exactly synthesizable unitaries. These results establish a strong baseline for future unitary synthesis algorithms.

This work has been submitted to the IEEE for possible publication. 12 pages, 6 figures, 1 table

References in corpus (10)

• Restrictions on Transversal Encoded Quantum Gate Sets
• Exact synthesis of multiqubit Clifford+T circuits
• Quantum circuit optimization with deep reinforcement learning
• Variational quantum compiling with double Q-learning
• LEAP: Scaling Numerical Optimization Based Synthesis Using an Incremental Approach
• T-count and T-depth of any multi-qubit unitary
• Quantum circuit synthesis with diffusion models
• Automated Quantum Circuit Design with Nested Monte Carlo Tree Search
• Hybrid discrete-continuous compilation of trapped-ion quantum circuits with deep reinforcement learning
• Quantum Circuit Distillation and Compression

Cited by in corpus (2)

• High-Precision Multi-Qubit Clifford+T Synthesis by Unitary Diagonalization
• Hybrid Reward-Driven Reinforcement Learning for Efficient Quantum Circuit Synthesis