Measurement-based adaptation protocol with quantum reinforcement learning

Abstract

Machine learning employs dynamical algorithms that mimic the human capacity to learn, where the reinforcement learning ones are among the most similar to humans in this respect. On the other hand, adaptability is an essential aspect to perform any task efficiently in a changing environment, and it is fundamental for many purposes, such as natural selection. Here, we propose an algorithm based on successive measurements to adapt one quantum state to a reference unknown state, in the sense of achieving maximum overlap. The protocol naturally provides many identical copies of the reference state, such that in each measurement iteration more information about it is obtained. In our protocol, we consider a system composed of three parts, the "environment" system, which provides the reference state copies; the register, which is an auxiliary subsystem that interacts with the environment to acquire information from it; and the agent, which corresponds to the quantum state that is adapted by digital feedback with input corresponding to the outcome of the measurements on the register. With this proposal we can achieve an average fidelity between the environment and the agent of more than $90\%$ with less than $30$ iterations of the protocol. In addition, we extend the formalism to $d$-dimensional states, reaching an average fidelity of around $80\%$ in less than $400$ iterations for $d=$ 11, for a variety of genuinely quantum and semiclassical states. This work paves the way for the development of quantum reinforcement learning protocols using quantum data and for the future deployment of semi-autonomous quantum systems.

References in corpus (11)

• An introduction to quantum machine learning
• Demonstration of Two-Qubit Algorithms with a Superconducting Quantum Processor
• Superconducting qubit in waveguide cavity with coherence time approaching 0.1ms
• Quantum-enhanced machine learning
• Feedback control of a solid-state qubit using high-fidelity projective measurement
• Initialization by measurement of a two-qubit superconducting circuit
• High-Fidelity Single-Shot Toffoli Gate via Quantum Control
• Multilevel superconducting circuits as two-qubit systems: Operations, state preparation, and entropic inequalities
• Qudit Quantum Computation in the Jaynes-Cummings Model
• Multiqubit and multilevel quantum reinforcement learning with quantum technologies
• Experimental study of optimal measurements for quantum state tomography

Cited by in corpus (32)

• Solving nonlinear differential equations with differentiable quantum circuits
• When does reinforcement learning stand out in quantum control? A comparative study on state preparation
• Geometric Speed Limit of Accessible Many-Body State Preparation
• Coherent Transport of Quantum States by Deep Reinforcement Learning
• Global optimization of quantum dynamics with AlphaZero deep exploration
• Reinforcement Learning for Many-Body Ground-State Preparation Inspired by Counterdiabatic Driving
• Reinforcement learning for autonomous preparation of Floquet-engineered states: Inverting the quantum Kapitza oscillator
• Glassy Phase of Optimal Quantum Control
• Reconstruction of a Photonic Qubit State with Reinforcement Learning
• Quantum machine learning and quantum biomimetics: A perspective
• Reinforcement Learning for Digital Quantum Simulation
• Improving the dynamics of quantum sensors with reinforcement learning
• Digital-analog quantum algorithm for the quantum Fourier transform
• Deep reinforcement learning for quantum Hamiltonian engineering
• Reinforcement learning for semi-autonomous approximate quantum eigensolver
• Retrieving Quantum Information with Active Learning
• Feedback Ansatz for Adaptive-Feedback Quantum Metrology Training with Machine Learning
• Measurement-based adaptation protocol with quantum reinforcement learning in a Rigetti quantum computer
• Benefits of Open Quantum Systems for Quantum Machine Learning
• Quantum Logic Gate Synthesis as a Markov Decision Process
• Quantum Machine Learning Implementations: Proposals and Experiments
• Robust optimization for quantum reinforcement learning control using partial observations
• Digital-analog co-design of the Harrow-Hassidim-Lloyd algorithm
• Solving Rubik's Cube via Quantum Mechanics and Deep Reinforcement Learning
• Creation and manipulation of quantized vortices in Bose-Einstein condensates using reinforcement learning
• Noise-Robust End-to-End Quantum Control using Deep Autoregressive Policy Networks
• Time-Optimal Quantum Driving by Variational Circuit Learning
• Experimental semi-autonomous eigensolver using reinforcement learning
• Adaptive Random Quantum Eigensolver
• Quantum Compiling by Deep Reinforcement Learning
• Noise-Resilient Quantum Reinforcement Learning
• Quantum Pattern Recognition in Photonic Circuits