Reinforcement Learning with Neural Networks for Quantum Multiple Hypothesis Testing

Abstract

Reinforcement learning with neural networks (RLNN) has recently demonstrated great promise for many problems, including some problems in quantum information theory. In this work, we apply RLNN to quantum hypothesis testing and determine the optimal measurement strategy for distinguishing between multiple quantum states $\{{\rho }_j\}$ while minimizing the error probability. In the case where the candidate states correspond to a quantum system with many qubit subsystems, implementing the optimal measurement on the entire system is experimentally infeasible. We use RLNN to find locally-adaptive measurement strategies that are experimentally feasible, where only one quantum subsystem is measured in each round. We provide numerical results which demonstrate that RLNN successfully finds the optimal local approach, even for candidate states up to 20 subsystems. We additionally demonstrate that the RLNN strategy meets or exceeds the success probability for a modified locally greedy approach in each random trial. While the use of RLNN is highly successful for designing adaptive local measurement strategies, in general a significant gap can exist between the success probability of the optimal locally-adaptive measurement strategy and the optimal collective measurement. We build on previous work to provide a set of necessary and sufficient conditions for collective protocols to strictly outperform locally adaptive protocols. We also provide a new example which, to our knowledge, is the simplest known state set exhibiting a significant gap between local and collective protocols. This result raises interesting new questions about the gap between theoretically optimal measurement strategies and practically implementable measurement strategies.

arXiv comment21 pages, 14 figures, accepted for publication in Quantum

References in corpus (34)

• Playing Atari with Deep Reinforcement Learning
• Quantum Nonlocality without Entanglement
• The operational meaning of min- and max-entropy
• Tune: A Research Platform for Distributed Model Selection and Training
• RLlib: Abstractions for Distributed Reinforcement Learning
• Active learning machine learns to create new quantum experiments
• Reinforcement Learning with Neural Networks for Quantum Feedback
• Machine Learning for Precise Quantum Measurement
• Quantum speedup for active learning agents
• Designing Optimal Quantum Detectors Via Semidefinite Programming
• Optimal local discrimination of two multipartite pure states
• Quantum channels showing superadditivity in capacity
• When does reinforcement learning stand out in quantum control? A comparative study on state preparation
• Machine learning for long-distance quantum communication
• Learning in Quantum Control: High-Dimensional Global Optimization for Noisy Quantum Dynamics
• Generalizable control for quantum parameter estimation through reinforcement learning
• Multiple copy 2-state discrimination with individual measurements
• Reinforcement Learning Decoders for Fault-Tolerant Quantum Computation
• Reinforcement learning for autonomous preparation of Floquet-engineered states: Inverting the quantum Kapitza oscillator
• Revisiting the Dolinar Receiver through Multiple-Copy State Discrimination Theory
• A Reinforcement Learning approach for Quantum State Engineering
• Reinforcement learning approach to non-equilibrium quantum thermodynamics
• A differentiable programming method for quantum control
• Multi-state discrimination below the quantum noise limit at the single-photon level
• Setting up experimental Bell test with reinforcement learning
• Multiple-copy state discrimination: Thinking globally, acting locally
• Optimal Measurements for Symmetric Quantum States with Applications to Optical Communication
• Robustness of Quantum-Enhanced Adaptive Phase Estimation
• Belief Propagation with Quantum Messages for Quantum-Enhanced Classical Communications
• Optimal sequential measurements for bi-partite state discrimination
• Multiple-copy state discrimination of noisy qubits
• Multi-state and multi-hypothesis discrimination with open quantum systems
• Single-shot Adaptive Measurement for Quantum-enhanced Metrology
• Adaptive Procedures for Discrimination Between Arbitrary Tensor-Product Quantum States