Quantum speedup for active learning agents

Abstract

Can quantum mechanics help us in building intelligent robots and agents? One of the defining characteristics of intelligent behavior is the capacity to learn from experience. However, a major bottleneck for agents to learn in any real-life situation is the size and complexity of the corresponding task environment. Owing to, e.g., a large space of possible strategies, learning is typically slow. Even for a moderate task environment, it may simply take too long to rationally respond to a given situation. If the environment is impatient, allowing only a certain time for a response, an agent may then be unable to cope with the situation and to learn at all. Here we show that quantum physics can help and provide a significant speed-up for active learning as a genuine problem of artificial intelligence. We introduce a large class of quantum learning agents for which we show a quadratic boost in their active learning efficiency over their classical analogues. This result will be particularly relevant for applications involving complex task environments.

Minor updates, 14 pages, 3 figures

References in corpus (3)

• Quantum algorithms for supervised and unsupervised machine learning
• Quantum Simulations of Classical Annealing Processes
• Speed-up via Quantum Sampling

Cited by in corpus (99)

• Quantum Machine Learning
• Quantum support vector machine for big data classification
• Noisy intermediate-scale quantum (NISQ) algorithms
• Efficient Learning for Deep Quantum Neural Networks
• Quantum-enhanced machine learning
• Harnessing disordered quantum dynamics for machine learning
• The Expressive Power of Parameterized Quantum Circuits
• Active learning machine learns to create new quantum experiments
• Quantum computing for finance
• Is quantum advantage the right goal for quantum machine learning?
• Experimental quantum speed-up in reinforcement learning agents
• Quantum reservoir processing
• Quantum Algorithm for Linear Regression
• Machine learning for long-distance quantum communication
• Quantum Machine Learning: from physics to software engineering
• Learning and Inference on Generative Adversarial Quantum Circuits
• Basic protocols in quantum reinforcement learning with superconducting circuits
• Advances in Quantum Reinforcement Learning
• Reinforcement learning for autonomous preparation of Floquet-engineered states: Inverting the quantum Kapitza oscillator
• Reconstruction of a Photonic Qubit State with Reinforcement Learning
• Reconstructing quantum states with quantum reservoir networks
• Optimal quantum networks and one-shot entropies
• Harnessing symmetry to control quantum transport
• Measurement-based adaptation protocol with quantum reinforcement learning
• Adaptive quantum computation in changing environments using projective simulation
• Realization of a quantum autoencoder for lossless compression of quantum data
• QFold: Quantum Walks and Deep Learning to Solve Protein Folding
• Quantum enhancements for deep reinforcement learning in large spaces
• Quantum machine learning and quantum biomimetics: A perspective
• Synchronization along quantum trajectories
• Projective simulation with generalization
• Machine learning \& artificial intelligence in the quantum domain
• Predicting quantum advantage by quantum walk with convolutional neural networks
• Meta-learning within Projective Simulation
• Quantum Martingale Theory and Entropy Production
• Quantum-enhanced deliberation of learning agents using trapped ions
• Quantum Reinforcement Learning: the Maze problem
• Quantum walks with sequential aperiodic jumps
• Multiqubit and multilevel quantum reinforcement learning with quantum technologies
• Speeding-up the decision making of a learning agent using an ion trap quantum processor
• Quantum Deep Reinforcement Learning for Robot Navigation Tasks
• Artificial Life in Quantum Technologies
• Hybrid classical-quantum linear solver using Noisy Intermediate-Scale Quantum machines
• Quantum Metropolis Solver: A Quantum Walks Approach to Optimization Problems
• Benchmarking projective simulation in navigation problems
• Reinforcement learning for semi-autonomous approximate quantum eigensolver
• Universal and optimal coin sequences for high entanglement generation in 1D discrete time quantum walks
• Faster quantum mixing for slowly evolving sequences of Markov chains
• Enhanced Quantum Synchronization via Quantum Machine Learning
• Analog quantum algorithms for the mixing of Markov chains
• Quantum reinforcement learning in continuous action space
• Measurement-based adaptation protocol with quantum reinforcement learning in a Rigetti quantum computer
• Quantum adaptive agents with efficient long-term memories
• Multiple transitions between normal and hyperballistic diffusion in quantum walks with time-dependent jumps
• Barren plateaus from learning scramblers with local cost functions
• Benefits of Open Quantum Systems for Quantum Machine Learning
• Quantifying scrambling in quantum neural networks
• Hybrid actor-critic algorithm for quantum reinforcement learning at CERN beam lines
• Quantum Uncertainty Principles for Measurements with Interventions
• Quantum machine learning with glow for episodic tasks and decision games
• Experimental demonstration of quantum learning speed-up with classical input data
• Quantum Algorithms for Reinforcement Learning with a Generative Model
• A quantum active learning algorithm for sampling against adversarial attacks
• Framework for learning agents in quantum environments
• Demonstration of a bosonic quantum classifier with data re-uploading
• Performance analysis of a hybrid agent for quantum-accessible reinforcement learning
• A quantum collisional classifier driven by information reservoir
• Quantum-accessible reinforcement learning beyond strictly epochal environments
• Quantum Slide and NAND Tree on a Photonic Chip
• Quantum Simulation of a Quantum Stochastic Walk
• Hybrid quantum-classical unsupervised data clustering based on the self-organizing feature map
• Reinforcement Learning Generation of 4-Qubits Entangled States
• Quantum reinforcement learning in the presence of thermal dissipation
• Quantum Entanglement and Cryptography for Automation and Control of Dynamic Systems
• Image Compression and Classification Using Qubits and Quantum Deep Learning
• Discrete-time Semiclassical Szegedy Quantum Walks
• The Roles of Kerr nonlinearity in a Bosonic Quantum Neural Network
• SQUWALS: A Szegedy QUantum WALks Simulator
• Exponential improvements for quantum-accessible reinforcement learning
• On the physical realizability of quantum stochastic walks
• Deep Reinforcement Learning with Quantum-inspired Experience Replay
• Adaptive Random Quantum Eigensolver
• Optimal spatial searches with long-range tunneling
• A Projective Simulation Scheme for Partially-Observable Multi-Agent Systems
• Active Learning in Physics: From 101, to Progress, and Perspective
• Policy Gradients using Variational Quantum Circuits
• Quantum Anomaly Detection with a Spin Processor in Diamond
• Implementing Semiclassical Szegedy Walks in Classical-Quantum Circuits for Homomorphic Encryption
• Faster quantum mixing of Markov chains in non-regular graph with fewer qubits
• Demonstration of quantum projective simulation on a single-photon-based quantum computer
• Complex-Phase Extensions of Szegedy Quantum Walk on Graphs
• Energetic advantages for quantum agents in online execution of complex strategies
• Exploring fixed points and eigenstates of quantum systems with reinforcement learning
• Quantum spatial best-arm identification via quantum walks
• Quantum Google Algorithm: Construction and Application to Complex Networks
• Quantum Projective Simulation with Hamiltonian Evolution: A study in reinforcement learning
• Noise-Resilient Quantum Reinforcement Learning
• Reinforcement Learning with Neural Networks for Quantum Multiple Hypothesis Testing
• Quantum-Inspired Weight-Constrained Neural Network: Reducing Variable Numbers by 100x Compared to Standard Neural Networks