Measurement-based adaptation protocol with quantum reinforcement learning
arXiv:1803.05340 · doi:10.1103/PhysRevA.98.042315
Abstract
Machine learning employs dynamical algorithms that mimic the human capacity to learn, where the reinforcement learning ones are among the most similar to humans in this respect. On the other hand, adaptability is an essential aspect to perform any task efficiently in a changing environment, and it is fundamental for many purposes, such as natural selection. Here, we propose an algorithm based on successive measurements to adapt one quantum state to a reference unknown state, in the sense of achieving maximum overlap. The protocol naturally provides many identical copies of the reference state, such that in each measurement iteration more information about it is obtained. In our protocol, we consider a system composed of three parts, the "environment" system, which provides the reference state copies; the register, which is an auxiliary subsystem that interacts with the environment to acquire information from it; and the agent, which corresponds to the quantum state that is adapted by digital feedback with input corresponding to the outcome of the measurements on the register. With this proposal we can achieve an average fidelity between the environment and the agent of more than with less than iterations of the protocol. In addition, we extend the formalism to -dimensional states, reaching an average fidelity of around in less than iterations for 11, for a variety of genuinely quantum and semiclassical states. This work paves the way for the development of quantum reinforcement learning protocols using quantum data and for the future deployment of semi-autonomous quantum systems.
References in corpus (35)
- Quantum Machine Learning
- Cavity quantum electrodynamics for superconducting electrical circuits: an architecture for quantum computation
- Machine learning phases of matter
- An introduction to quantum machine learning
- Searching for Exotic Particles in High-Energy Physics with Deep Learning
- Demonstration of Two-Qubit Algorithms with a Superconducting Quantum Processor
- Observation of high coherence in Josephson junction qubits measured in a three-dimensional circuit QED architecture
- Many-body quantum state tomography with neural networks
- Quantum cloning
- Superconducting qubit in waveguide cavity with coherence time approaching 0.1ms
- Digitized adiabatic quantum computing with a superconducting circuit
- Quantum-enhanced machine learning
- Reinforcement Learning in Different Phases of Quantum Control
- Opportunities and challenges for quantum-assisted machine learning in near-term quantum computers
- Feedback control of a solid-state qubit using high-fidelity projective measurement
- Quantum speedup for active learning agents
- Improving Quantum State Estimation with Mutually Unbiased Bases
- Initialization by measurement of a two-qubit superconducting circuit
- High-Fidelity Single-Shot Toffoli Gate via Quantum Control
- Quantum-Assisted Learning of Hardware-Embedded Probabilistic Graphical Models
- Quantum learning and universal quantum matching machine
- A NASA Perspective on Quantum Computing: Opportunities and Challenges
- Quantum-assisted Helmholtz machines: A quantum-classical deep learning framework for industrial datasets in near-term devices
- Multilevel superconducting circuits as two-qubit systems: Operations, state preparation, and entropic inequalities
- Basic protocols in quantum reinforcement learning with superconducting circuits
- Designing High-Fidelity Single-Shot Three-Qubit Gates: A Machine Learning Approach
- Adaptive quantum computation in changing environments using projective simulation
- Measurement driven quantum evolution
- Qudit Quantum Computation in the Jaynes-Cummings Model
- Supervised Quantum Learning without Measurements
- Quantum logic gates for superconducting resonator qudits
- Projective simulation for classical learning agents: a comprehensive investigation
- Projective simulation with generalization
- Multiqubit and multilevel quantum reinforcement learning with quantum technologies
- Experimental study of optimal measurements for quantum state tomography
Cited by in corpus (32)
- Solving nonlinear differential equations with differentiable quantum circuits
- When does reinforcement learning stand out in quantum control? A comparative study on state preparation
- Geometric Speed Limit of Accessible Many-Body State Preparation
- Coherent Transport of Quantum States by Deep Reinforcement Learning
- Global optimization of quantum dynamics with AlphaZero deep exploration
- Reinforcement Learning for Many-Body Ground-State Preparation Inspired by Counterdiabatic Driving
- Reinforcement learning for autonomous preparation of Floquet-engineered states: Inverting the quantum Kapitza oscillator
- Glassy Phase of Optimal Quantum Control
- Reconstruction of a Photonic Qubit State with Reinforcement Learning
- Quantum machine learning and quantum biomimetics: A perspective
- Reinforcement Learning for Digital Quantum Simulation
- Improving the dynamics of quantum sensors with reinforcement learning
- Digital-analog quantum algorithm for the quantum Fourier transform
- Deep reinforcement learning for quantum Hamiltonian engineering
- Reinforcement learning for semi-autonomous approximate quantum eigensolver
- Retrieving Quantum Information with Active Learning
- Feedback Ansatz for Adaptive-Feedback Quantum Metrology Training with Machine Learning
- Measurement-based adaptation protocol with quantum reinforcement learning in a Rigetti quantum computer
- Benefits of Open Quantum Systems for Quantum Machine Learning
- Quantum Logic Gate Synthesis as a Markov Decision Process
- Quantum Machine Learning Implementations: Proposals and Experiments
- Robust optimization for quantum reinforcement learning control using partial observations
- Digital-analog co-design of the Harrow-Hassidim-Lloyd algorithm
- Solving Rubik's Cube via Quantum Mechanics and Deep Reinforcement Learning
- Creation and manipulation of quantized vortices in Bose-Einstein condensates using reinforcement learning
- Noise-Robust End-to-End Quantum Control using Deep Autoregressive Policy Networks
- Time-Optimal Quantum Driving by Variational Circuit Learning
- Experimental semi-autonomous eigensolver using reinforcement learning
- Adaptive Random Quantum Eigensolver
- Quantum Compiling by Deep Reinforcement Learning
- Noise-Resilient Quantum Reinforcement Learning
- Quantum Pattern Recognition in Photonic Circuits