Reinforcement learning with learned gadgets to tackle hard quantum problems on real hardware

Abstract

Quantum computing offers exciting opportunities for simulating complex quantum systems and optimizing large scale combinatorial problems, but its practical use is limited by device noise and constrained connectivity. Designing quantum circuits, which are fundamental to quantum algorithms, is therefore a central challenge in current quantum hardware. Existing reinforcement learning based methods for circuit design lose accuracy when restricted to hardware native gates and device level compilation. Here, we introduce gadget reinforcement learning (GRL), which combines learning with program synthesis to automatically construct composite gates that expand the action space while respecting hardware constraints. We show that this approach improves accuracy, hardware compatibility, and scalability for transverse-field Ising and quantum chemistry problems, reaching systems of up to ten qubits within realistic computational budgets. This framework demonstrates how learned, reusable circuit building blocks can guide the co-design of algorithms and hardware for quantum processors.

28 page: Gadget reinforcement learning

References in corpus (16)

• Hardware-efficient Variational Quantum Eigensolver for Small Molecules and Quantum Magnets
• An adaptive variational algorithm for exact molecular simulations on a quantum computer
• Realization of a scalable Shor algorithm
• qubit-ADAPT-VQE: An adaptive algorithm for constructing hardware-efficient ansatze on a quantum processor
• Artificial Intelligence and Machine Learning for Quantum Technologies
• Overlap-ADAPT-VQE: Practical Quantum Chemistry on Quantum Computers via Overlap-Guided Compact Ansätze
• KANQAS: Kolmogorov-Arnold Network for Quantum Architecture Search
• Quantum approximate optimization via learning-based adaptive optimization
• MQT QMAP: Efficient Quantum Circuit Mapping
• Strategy for quantum algorithm design assisted by machine learning
• An Algebraic Quantum Circuit Compression Algorithm for Hamiltonian Simulation
• Reinforcement Learning Assisted Recursive QAOA
• A Case for Synthesis of Recursive Quantum Unitary Programs
• Hybrid quantum-classical algorithm for the transverse-field Ising model in the thermodynamic limit
• A quantum information theoretic analysis of reinforcement learning-assisted quantum architecture search
• Quantum Criticality in the infinite-range Transverse Field Ising Model