Applications of model-aware reinforcement learning in Bayesian quantum metrology
arXiv:2403.05706 · doi:10.1103/PhysRevA.109.062609
Abstract
An important practical problem in the field of quantum metrology and sensors is to find the optimal sequences of controls for the quantum probe that realize optimal adaptive estimation. In Belliardo et al., arXiv:2312.16985 (2023), we solved this problem in general, by introducing a procedure capable of optimizing a wide range of tasks in quantum metrology and estimation by combining model-aware reinforcement learning with Bayesian inference. We take a model-based approach to the optimisation where the physics describing the system is explicitly taken into account in the training through automatic differentiation. In this follow-up paper we present some applications of the framework. The first family of examples concerns the estimation of magnetic fields, hyperfine interactions, and decoherence times for electronic spins in diamond. For these examples, we perform multiple Ramsey measurements on the spin. The second family of applications concerns the estimation of phases and coherent states on photonic circuits, without squeezing elements, where the bosonic lines are measured by photon counters. This exposition showcases the broad applicability of the method, which has been implemented in the qsensoropt library released on PyPI, which can be installed with pip.
35 pages, 16 figures
References in corpus (56)
- Sensitivity Optimization for NV-Diamond Magnetometry
- Quantum Enhanced Multiple Phase Estimation
- Reinforcement Learning in Different Phases of Quantum Control
- Experimental Quantum Hamiltonian Learning
- Reinforcement Learning with Neural Networks for Quantum Feedback
- Hamiltonian Learning and Certification Using Quantum Resources
- Robust Online Hamiltonian Learning
- Optimal metrology with programmable quantum sensors
- Experimental Bayesian Quantum Phase Estimation on a Silicon Photonic Chip
- Optimized quantum sensing with a single electron spin using real-time adaptive measurements
- Experimental neural network enhanced quantum tomography
- Designing Optimal Quantum Detectors Via Semidefinite Programming
- Artificial Intelligence and Machine Learning for Quantum Technologies
- Learning Quantum Systems
- Introduction to Quantum Optimal Control for Quantum Sensing with Nitrogen-Vacancy Centers in Diamond
- Quantum parameter estimation with optimal control
- When does reinforcement learning stand out in quantum control? A comparative study on state preparation
- A variational toolbox for quantum multi-parameter estimation
- Quantum Variational Optimization of Ramsey Interferometry and Atomic Clocks
- Generalizable control for quantum parameter estimation through reinforcement learning
- Experimental multiphase estimation on a chip
- Displacement receiver for phase-shift-keyed coherent states
- Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements
- How to best sample a periodic probability distribution, or on the accuracy of Hamiltonian finding strategies
- Calibration of quantum sensors by neural networks
- QuanEstimation: An open-source toolkit for quantum parameter estimation
- Variational principle for optimal quantum controls in quantum metrology
- Deep reinforcement learning for quantum multiparameter estimation
- Bayesian estimation for quantum sensing in the absence of single-shot detection
- Optimal and Variational Multi-Parameter Quantum Metrology and Vector Field Sensing
- Neural-Network Heuristics for Adaptive Bayesian Quantum Estimation
- Improving the dynamics of quantum sensors with reinforcement learning
- Incompatibility in Quantum Parameter Estimation
- Magnetic-field-learning using a single electronic spin in diamond with one-photon-readout at room temperature
- Machine-learning-enhanced quantum sensors for accurate magnetic field imaging
- QInfer: Statistical inference software for quantum applications
- Gradient Ascent Pulse Engineering with Feedback
- Achieving Heisenberg scaling with maximally entangled states: an analytic upper bound for the attainable root mean square error
- Deep Reinforcement Learning for Efficient Measurement of Quantum Devices
- Adaptive tracking of a time-varying field with a quantum sensor
- Photonic architecture for reinforcement learning
- Generalizable control for multiparameter quantum metrology
- Machine Learning and Quantum Devices
- Robust Magnetometry with Single NV Centers via Two-step Optimization
- Efficient and Robust Entanglement Generation with Deep Reinforcement Learning for Quantum Metrology
- Non-asymptotic Heisenberg scaling: experimental metrology for a wide resources range
- Adaptive Hamiltonian Estimation Using Bayesian Experimental Design
- Neural-network-based parameter estimation for quantum detection
- Resource-efficient adaptive Bayesian tracking of magnetic fields with a quantum sensor
- Photonic quantum metrology with variational quantum optical non-linearities
- Real-time adaptive estimation of decoherence timescales for a single qubit
- Super-Resolution Imaging with Multiparameter Quantum Metrology in Passive Remote Sensing
- An agnostic-Dolinar receiver for coherent states classification
- Real-time frequency estimation of a qubit without single-shot-readout
- Framework for Learning and Control in the Classical and Quantum Domains
- Application of machine learning to experimental design in quantum mechanics
Cited by in corpus (4)
- Model-aware reinforcement learning for high-performance Bayesian experimental design in quantum metrology
- Optimization of Quantum-Repeater Networks using Stochastic Automatic Differentiation
- Saturable global quantum sensing
- QuanEstimation.jl: An open-source Julia framework for quantum parameter estimation