A Tutorial on Optimal Control and Reinforcement Learning methods for Quantum Technologies

Abstract

Quantum Optimal Control is an established field of research which is necessary for the development of Quantum Technologies. In recent years, Machine Learning techniques have been proved usefull to tackle a variety of quantum problems. In particular, Reinforcement Learning has been employed to address typical problems of control of quantum systems. In this tutorial we introduce the methods of Quantum Optimal Control and Reinforcement Learning by applying them to the problem of three-level population transfer. The jupyter notebooks to reproduce some of our results are open-sourced and available on github.

arXiv comment15 pages, 11 figures

References in corpus (54)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• Machine learning and the physical sciences
• QuTiP 2: A Python framework for the dynamics of open quantum systems
• Solving the Quantum Many-Body Problem with Artificial Neural Networks
• Shortcuts to adiabaticity: concepts, methods, and applications
• A high-bias, low-variance introduction to Machine Learning for physicists
• Stimulated Raman adiabatic passage in physics, chemistry and beyond
• Training Schrödinger's cat: quantum optimal control
• Efficient Learning for Deep Quantum Neural Networks
• The European Quantum Technologies Roadmap
• Quantum autoencoders for efficient compression of quantum data
• Optimal control technique for Many Body Quantum Systems dynamics
• Chopped random-basis quantum optimization
• Optimal control theory for unitary transformations
• Controlling open quantum systems: Tools, achievements, and limitations
• Reinforcement Learning with Neural Networks for Quantum Feedback
• Monotonically convergent optimization in quantum control using Krotov's method
• Introduction to the Pontryagin Maximum Principle for Quantum Optimal Control
• Machine Learning for Precise Quantum Measurement
• Gradient optimization of analytic controls: the route to high accuracy quantum optimal control
• Stimulated Raman adiabatic passage in a three-level superconducting circuit
• Experimental quantum speed-up in reinforcement learning agents
• Superadiabatic population transfer in a three-level superconducting circuit
• Loading a Bose-Einstein Condensate onto an Optical Lattice: an Application of Optimal Control Theory to The Non Linear Schrödinger Equation
• Introduction to Quantum Optimal Control for Quantum Sensing with Nitrogen-Vacancy Centers in Diamond
• Dressing the chopped-random-basis optimization: a bandwidth-limited access to the trap-free landscape
• Robust optimal quantum gates for Josephson charge qubits
• When does reinforcement learning stand out in quantum control? A comparative study on state preparation
• Krotov: A Python implementation of Krotov's method for quantum optimal control
• Three-level superadiabatic quantum driving
• An Efficient Algorithm for Optimizing Adaptive Quantum Metrology Processes
• Optimal control theory for a unitary operation under dissipative evolution
• Coherent Transport of Quantum States by Deep Reinforcement Learning
• Prediction and real-time compensation of qubit decoherence via machine-learning
• Measurement Based Feedback Quantum Control With Deep Reinforcement Learning for Double-well Non-linear Potential
• Protecting coherence in Optimal Control Theory: State dependent constraint approach
• Charting the circuit QED design landscape using optimal control theory
• Optimizing for an arbitrary perfect entangler: I. Functionals
• Quantum optimal control via gradient ascent in function space and the time-bandwidth quantum speed limit
• Reinforcement learning approach to non-equilibrium quantum thermodynamics
• Quantum optimal control of multi-level dissipative quantum systems with Reinforcement Learning
• Optimizing for an arbitrary perfect entangler. II. Application
• Beyond Quantum Noise Spectroscopy: modelling and mitigating noise with quantum feature engineering
• Coherent manipulation of noise-protected superconducting artificial atoms in the Lambda scheme
• Hybrid Optimization Schemes for Quantum Control
• Reinforcement learning-enhanced protocols for coherent population-transfer in three-level quantum systems
• Classifying global state preparation via deep reinforcement learning
• Population transfer in a Lambda system induced by detunings
• Robust control of entanglement in a Nitrogen-vacancy centre coupled to a Carbon-13 nuclear spin in diamond
• Controllability on relaxation-free subspaces: On the relationship between adiabatic population transfer and optimal control
• Simulating spin chains using a superconducting circuit: gauge invariance, superadiabatic transport, and broken time-reversal symmetry
• Ultrastrong coupling probed by Coherent Population Transfer
• Optimally controlled quantum discrimination and estimation
• Probing Ultrastrong Light-Matter Coupling in Open Quantum Systems

Cited by in corpus (31)

• One decade of quantum optimal control in the chopped random basis
• Introduction to Theoretical and Experimental aspects of Quantum Optimal Control
• Detecting virtual photons in ultrastrongly coupled superconducting quantum circuits
• Spectral Density Classification For Environment Spectroscopy
• Optimal quantum control via genetic algorithms for quantum state engineering in driven-resonator mediated networks
• Taming quantum systems: A tutorial for using shortcuts-to-adiabaticity, quantum optimal control, and reinforcement learning
• Quantum Logic Gate Synthesis as a Markov Decision Process
• Designing dynamically corrected gates robust to multiple noise sources using geometric space curves
• Quantum control of continuous systems via nonharmonic potential modulation
• Machine Learning for Estimation and Control of Quantum Systems
• Enhanced quantum state preparation via stochastic prediction of neural network
• Fast generation of entanglement between coupled spins using optimization and deep learning methods
• Quantifying protocol efficiency: a thermodynamic figure of merit for classical and quantum state-transfer protocols
• Adiabatic quantum trajectories in engineered reservoirs
• Fast storage of photons in cavity-assisted quantum memories
• Integrated conversion and photodetection of virtual photons in an ultrastrongly coupled superconducting quantum circuit
• Quantum optimal control in quantum technologies. Strategic report on current status, visions and goals for research in Europe
• A numerical approach for calculating exact non-adiabatic terms in quantum dynamics
• Characterization of a driven two-level quantum system by Supervised Learning
• Control landscapes for high-fidelity generation of C-NOT and C-PHASE gates with coherent and environmental driving
• Noise Classification in Three-Level Quantum Networks by Machine Learning
• Machine learning non-Markovian two-level quantum noise spectroscopy
• Coarse-grained effective Hamiltonian via the Magnus Expansion for a three-level system
• Bursts of polarised single photons from atom-cavity sources
• Open-loop quantum control of small-size networks for high-order cumulants and cross-correlations sensing
• Machine-learning-inspired quantum control in many-body dynamics
• Attention-Based Deep Reinforcement Learning for Qubit Allocation in Modular Quantum Architectures
• Optimal control of a dissipative micromaser quantum battery in the ultrastrong coupling regime
• Quantum state-preparation control in noisy environment via most-likely paths
• Channel capacity of small modular quantum networks in the ultrastrongly coupled regime
• Two-level control over quantum state creation via entangled equal-probability state