Real-time calibration of coherent-state receivers: learning by trial and error

Abstract

The optimal discrimination of coherent states of light with current technology is a key problem in classical and quantum communication, whose solution would enable the realization of efficient receivers for long-distance communications in free-space and optical fiber channels. In this article, we show that reinforcement learning (RL) protocols allow an agent to learn near-optimal coherent-state receivers made of passive linear optics, photodetectors and classical adaptive control. Each agent is trained and tested in real time over several runs of independent discrimination experiments and has no knowledge about the energy of the states nor the receiver setup nor the quantum-mechanical laws governing the experiments. Based exclusively on the observed photodetector outcomes, the agent adaptively chooses among a set of ~3 10^3 possible receiver setups, and obtains a reward at the end of each experiment if its guess is correct. At variance with previous applications of RL in quantum physics, the information gathered in each run is intrinsically stochastic and thus insufficient to evaluate exactly the performance of the chosen receiver. Nevertheless, we present families of agents that: (i) discover a receiver beating the best Gaussian receiver after ~3 10^2 experiments; (ii) surpass the cumulative reward of the best Gaussian receiver after ~10^3 experiments; (iii) simultaneously discover a near-optimal receiver and attain its cumulative reward after ~10^5 experiments. Our results show that RL techniques are suitable for on-line control of quantum receivers and can be employed for long-distance communications over potentially unknown channels.

arXiv comment14+3 pages, 11 figures

References in corpus (41)

• Quantum Cryptography
• Quantum cryptography: Public key distribution and coin tossing
• Gaussian Quantum Information
• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Continuous variable quantum cryptography using coherent states
• Machine learning phases of matter
• Many-body quantum state tomography with neural networks
• Learning phase transitions by confusion
• Quantum Cryptography with Coherent States
• Quantum generative adversarial learning
• Reinforcement Learning in Different Phases of Quantum Control
• Active learning machine learns to create new quantum experiments
• Reinforcement Learning with Neural Networks for Quantum Feedback
• A Neural Decoder for Topological Codes
• Discrimination of the binary coherent signal: Gaussian-operation limit and simple non-Gaussian near-optimal receivers
• Unambiguous state discrimination in quantum cryptography with weak coherent states
• Structured optical receivers to attain superadditive capacity and the Holevo limit
• Polar codes for classical-quantum channels
• Intracity quantum communication via thermal microwave networks
• Adversarial quantum circuit learning for pure state approximation
• Distinguishing between optical coherent states with imperfect detection
• Implementation of projective measurements with linear optics and continuous photon counting
• Polar coding to achieve the Holevo capacity of a pure-loss optical channel
• Robust Measurement for the Discrimination of Binary Coherent States
• Optimized communication strategies with binary coherent states over phase noise channels
• Binary projective measurement via linear optics and photon counting
• A robust quantum receiver for phase shift keyed signals
• Capacity of optical communication in loss and noise with general Gaussian receivers
• Quantum learning: optimal classification of qubit states
• Realizable receivers for discriminating arbitrary coherent-state waveforms and multi-copy quantum states near the quantum limit
• Achieving minimum-error discrimination of an arbitrary set of laser-light pulses
• Quantum learning of coherent states
• Coherent-state discrimination via non-heralded probabilistic amplification
• Multi-copy programmable discrimination of general qubit states
• Optimal Measurements for Symmetric Quantum States with Applications to Optical Communication
• Multi-Phase Hadamard receivers for classical communication on lossy bosonic channels
• Optimal universal learning machines for quantum state discrimination
• Achieving the Holevo bound via a bisection decoding protocol
• The capacity of coherent-state adaptive decoders with interferometry and single-mode detectors
• Range Dependence of an Optical Pulse Position Modulation Link in the Presence of Background Noise
• Deep Reinforcement Learning with Decorrelation

Cited by in corpus (12)

• Model-Free Quantum Control with Reinforcement Learning
• Measurement Based Feedback Quantum Control With Deep Reinforcement Learning for Double-well Non-linear Potential
• Quantum Receiver Enhanced by Adaptive Learning
• Discriminating qubit amplitude damping channels
• Accelerated Magnonic Motional Cooling with Deep Reinforcement Learning
• An agnostic-Dolinar receiver for coherent states classification
• Optimal quantum discrimination of single-qubit unitary gates between two candidates
• Reinforcement-learning calibration of coherent-state receivers on variable-loss optical channels
• Model-aware reinforcement learning for high-performance Bayesian experimental design in quantum metrology
• A learning theory for quantum photonic processors and beyond
• Greedy receiver for photon-efficient optical communication
• Channel-noise tracking for sub-shot-noise-limited receivers with neural networks