Quantum Reinforcement Learning: the Maze problem

Abstract

Quantum Machine Learning (QML) is a young but rapidly growing field where quantum information meets machine learning. Here, we will introduce a new QML model generalizing the classical concept of Reinforcement Learning to the quantum domain, i.e. Quantum Reinforcement Learning (QRL). In particular we apply this idea to the maze problem, where an agent has to learn the optimal set of actions in order to escape from a maze with the highest success probability. To perform the strategy optimization, we consider an hybrid protocol where QRL is combined with classical deep neural networks. In particular, we find that the agent learns the optimal strategy in both the classical and quantum regimes, and we also investigate its behaviour in a noisy environment. It turns out that the quantum speedup does robustly allow the agent to exploit useful actions also at very short time scales, with key roles played by the quantum coherence and the external noise. This new framework has the high potential to be applied to perform different tasks (e.g. high transmission/processing rates and quantum error correction) in the new-generation Noisy Intermediate-Scale Quantum (NISQ) devices whose topology engineering is starting to become a new and crucial control knob for practical applications in real-world problems. This work is dedicated to the memory of Peter Wittek.

arXiv comment10 pages, 10 figures

References in corpus (22)

• PyTorch: An Imperative Style, High-Performance Deep Learning Library
• Quantum Machine Learning
• QuTiP: An open-source Python framework for the dynamics of open quantum systems
• An introduction to quantum machine learning
• Concepts and methods in the theory of open quantum systems
• Highly efficient energy excitation transfer in light-harvesting complexes: The fundamental role of noise-assisted transport
• Tune: A Research Platform for Distributed Model Selection and Training
• Quantum-enhanced machine learning
• Quantum channels and memory effects
• Bayesian Reinforcement Learning: A Survey
• Unsupervised Machine Learning on a Hybrid Quantum Computer
• Quantum speedup for active learning agents
• Experimental quantum speed-up in reinforcement learning agents
• Quantum generative adversarial learning in a superconducting quantum circuit
• Quantum stochastic walks: A generalization of classical random walks and quantum walks
• Fast Escape from Quantum Mazes in Integrated Photonics
• Training a Binary Classifier with the Quantum Adiabatic Algorithm
• Quantum embeddings for machine learning
• Universally Optimal Noisy Quantum Walks on Complex Networks
• rlpyt: A Research Code Base for Deep Reinforcement Learning in PyTorch
• Advances in quantum machine learning
• Quantum State Discrimination on Reconfigurable Noise-Robust Quantum Networks

Cited by in corpus (6)

• Quantum-Noise-Driven Generative Diffusion Models
• Quantum Deep Reinforcement Learning for Robot Navigation Tasks
• The role of data embedding in equivariant quantum convolutional neural networks
• Efficient learning of mixed-state tomography for photonic quantum walk
• Quantum inspired qubit qutrit neural networks for real time financial forecasting
• Recurrence in discrete-time quantum stochastic walks