Generalizable control for quantum parameter estimation through reinforcement learning

Abstract

Measurement and estimation of parameters are essential for science and engineering, where one of the main quests is to find systematic schemes that can achieve high precision. While conventional schemes for quantum parameter estimation focus on the optimization of the probe states and measurements, it has been recently realized that control during the evolution can significantly improve the precision. The identification of optimal controls, however, is often computationally demanding, as typically the optimal controls depend on the value of the parameter which then needs to be re-calculated after the update of the estimation in each iteration. Here we show that reinforcement learning provides an efficient way to identify the controls that can be employed to improve the precision. We also demonstrate that reinforcement learning is highly generalizable, namely the neural network trained under one particular value of the parameter can work for different values within a broad range. These desired features make reinforcement learning an efficient alternative to conventional optimal quantum control methods.

arXiv comment7+7 pages, 6+3 figures

References in corpus (30)

• Quantum sensing
• Advances in Quantum Metrology
• Concepts and methods in the theory of open quantum systems
• Generalized uncertainty relations: Theory, examples, and Lorentz invariance
• Imaging with a small number of photons
• Quantum enhanced measurements without entanglement
• Optimal control technique for Many Body Quantum Systems dynamics
• Optimal control theory for unitary transformations
• Active learning machine learns to create new quantum experiments
• Quantum Imaging
• Comparing, Optimising and Benchmarking Quantum Control Algorithms in a Unifying Programming Framework
• Monotonically convergent optimization in quantum control using Krotov's method
• Optimal adaptive control for quantum metrology with time-dependent Hamiltonians
• Quantum metrology for a general Hamiltonian parameter
• Loading a Bose-Einstein Condensate onto an Optical Lattice: an Application of Optimal Control Theory to The Non Linear Schrödinger Equation
• Introduction to quantum Fisher information
• Quantum parameter estimation with optimal control
• Quantum metrology with full and fast quantum control
• Deep Reinforcement Learning for Quantum Gate Control
• Universal time scaling for Hamiltonian parameter estimation
• Machine learning for long-distance quantum communication
• Sequential feedback scheme outperforms the parallel scheme for Hamiltonian parameter estimation
• Robustness of high-fidelity Rydberg gates with single-site addressability
• Control-enhanced multiparameter quantum estimation
• Automatic spin-chain learning to explore the quantum speed limit
• Achieving optimal quantum acceleration of frequency estimation using adaptive coherent control
• Hybrid Optimization Schemes for Quantum Control
• Quantum parameter estimation with the Landau-Zener transition
• Enhancing sensitivity in quantum metrology by Hamiltonian extensions
• Security against jamming and noise exclusion in imaging

Cited by in corpus (56)

• Quantum Fisher information matrix and multiparameter estimation
• Artificial Intelligence and Machine Learning for Quantum Technologies
• Machine Learning for Quantum Matter
• Model-Free Quantum Control with Reinforcement Learning
• When does reinforcement learning stand out in quantum control? A comparative study on state preparation
• Machine learning for long-distance quantum communication
• Quantum Machine Learning: from physics to software engineering
• Global sensing and its impact for quantum many-body probes with criticality
• Global optimization of quantum dynamics with AlphaZero deep exploration
• Variational Quantum Algorithm for Estimating the Quantum Fisher Information
• Review: Quantum Metrology and Sensing with Many-Body Systems
• Optimal Scheme for Quantum Metrology
• Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements
• Model-free tracking control of complex dynamical trajectories with machine learning
• QuanEstimation: An open-source toolkit for quantum parameter estimation
• Quantum optimal control of multi-level dissipative quantum systems with Reinforcement Learning
• Quantum machine learning and quantum biomimetics: A perspective
• Improving the dynamics of quantum sensors with reinforcement learning
• Self-Correcting Quantum Many-Body Control using Reinforcement Learning with Tensor Networks
• Optimal approximate quantum error correction for quantum metrology
• Deep Reinforcement Learning for Efficient Measurement of Quantum Devices
• Classifying global state preparation via deep reinforcement learning
• Generalizable control for multiparameter quantum metrology
• Optimally controlled quantum discrimination and estimation
• Efficient and Robust Entanglement Generation with Deep Reinforcement Learning for Quantum Metrology
• Generic detection-based error-mitigation using quantum autoencoders
• Numerical evidence against advantage with quantum fidelity kernels on classical data
• Quantum reinforcement learning in continuous action space
• An automated approach for consecutive tuning of quantum dot arrays
• Machine classification for probe based quantum thermometry
• Generation and storage of spin squeezing via learning-assisted optimal control
• Fast, high precision dynamics in quantum optimal control theory
• Frequentist Parameter Estimation with Supervised Learning
• Detection of entangled states supported by reinforcement learning
• Neural-network-based parameter estimation for quantum detection
• Data-Centric Machine Learning in Quantum Information Science
• Control-enhanced quantum metrology under Markovian noise
• A Neural Network Assisted ${}^{171}$Yb${}^{+}$ Quantum Magnetometer
• Machine Learning for Estimation and Control of Quantum Systems
• Approximations in transmon simulation
• Multiparameter simultaneous optimal estimation with an SU(2) coding unitary evolution
• Time-local optimal control for parameter estimation in the Gaussian regime
• Optimal control for Hamiltonian parameter estimation in non-commuting and bipartite quantum dynamics
• Unsupervised Machine Learning of Quenched Gauge Symmetries: A Proof-of-Concept Demonstration
• Reinforcement learning assisted non-reciprocal optomechanical gyroscope
• Model-aware reinforcement learning for high-performance Bayesian experimental design in quantum metrology
• Applications of model-aware reinforcement learning in Bayesian quantum metrology
• Framework for Learning and Control in the Classical and Quantum Domains
• Reinforcement Learning for Rotation Sensing with Ultracold Atoms in an Optical Lattice
• Disti-Mator: an entanglement distillation-based state estimator
• Iterative optimization in quantum metrology and entanglement theory using semidefinite programming
• Research progress of artificial intelligence empowered quantum communication and quantum sensing systems
• Limitations of strong coupling in non-Markovian quantum thermometry
• Reinforcement Learning with Neural Networks for Quantum Multiple Hypothesis Testing
• Bounding fidelity in quantum feedback control: theory and applications to Dicke state preparation
• Noise-Resilient Quantum Reinforcement Learning