Control of Stochastic Quantum Dynamics by Differentiable Programming

Abstract

Control of the stochastic dynamics of a quantum system is indispensable in fields such as quantum information processing and metrology. However, there is no general ready-made approach to the design of efficient control strategies. Here, we propose a framework for the automated design of control schemes based on differentiable programming ($\partial \mathrm{P}$). We apply this approach to the state preparation and stabilization of a qubit subjected to homodyne detection. To this end, we formulate the control task as an optimization problem where the loss function quantifies the distance from the target state, and we employ neural networks (NNs) as controllers. The system's time evolution is governed by a stochastic differential equation (SDE). To implement efficient training, we backpropagate the gradient information from the loss function through the SDE solver using adjoint sensitivity methods. As a first example, we feed the quantum state to the controller and focus on different methods of obtaining gradients. As a second example, we directly feed the homodyne detection signal to the controller. The instantaneous value of the homodyne current contains only very limited information on the actual state of the system, masked by unavoidable photon-number fluctuations. Despite the resulting poor signal-to-noise ratio, we can train our controller to prepare and stabilize the qubit to a target state with a mean fidelity of around 85%. We also compare the solutions found by the NN to a hand-crafted control strategy.

arXiv commentequivalent to published version, 19+17 pages, 5+3 figures

References in corpus (37)

• Discovering governing equations from data: Sparse identification of nonlinear dynamical systems
• DGM: A deep learning algorithm for solving partial differential equations
• Training Schrödinger's cat: quantum optimal control
• Feedback-control of quantum systems using continuous state-estimation
• Quantum feedback control of a superconducting qubit: Persistent Rabi oscillations
• Proposal for teleportation of an atomic state via cavity decay
• Sparse identification of nonlinear dynamics for model predictive control in the low-data limit
• Chopped random-basis quantum optimization
• Optomechanical Cooling of a Macroscopic Oscillator by Homodyne Feedback
• Measurement and control of a mechanical oscillator at its thermal decoherence rate
• Adaptive homodyne measurement of optical phase
• Reinforcement Learning in Different Phases of Quantum Control
• Quantum feedback: theory, experiments, and applications
• Sparse learning of stochastic dynamic equations
• Differentiable Programming Tensor Networks
• Speedup for quantum optimal control from automatic differentiation based on graphics processing units
• Learning Robust and High-Precision Quantum Controls
• Optimal state estimation for cavity optomechanical systems
• Using a Recurrent Neural Network to Reconstruct Quantum Dynamics of a Superconducting Qubit from Physical Observations
• Gradient-based optimal control of open quantum systems using quantum trajectories and automatic differentiation
• Dynamics of a qubit while simultaneously monitoring its relaxation and dephasing
• Reinforcement learning for autonomous preparation of Floquet-engineered states: Inverting the quantum Kapitza oscillator
• Quantum-Limited Mirror-Motion Estimation
• Hamilton-Jacobi-Bellman equations for Quantum Filtering and Control
• Entanglement within the Quantum Trajectory Description of Open Quantum Systems
• Hamiltonian Learning for Quantum Error Correction
• Quantum control of atomic systems by time resolved homodyne detection and feedback
• A differentiable programming method for quantum control
• Optical phase-space reconstruction of mirror position at the attometer level
• Mapping quantum state dynamics in spontaneous emission
• Entanglement dynamics in open two-qubit systems via diffusive quantum trajectories
• Stochastic Estimation of Dynamical Variables
• Continuous-discrete smoothing of diffusions
• Quantum teleportation with continuous measurements
• Unraveling nonclassicality in the optomechanical instability
• Automatic Backward Filtering Forward Guiding for Markov processes and graphical models
• Heralded dissipative preparation of nonclassical states in a Kerr oscillator

Cited by in corpus (12)

• Artificial Intelligence and Machine Learning for Quantum Technologies
• Learning Quantum Systems
• Gradient Ascent Pulse Engineering with Feedback
• Pareto-optimal cycles for power, efficiency and fluctuations of quantum heat engines using reinforcement learning
• Optimal control of families of quantum gates
• Quantum Optimal Control via Semi-Automatic Differentiation
• Protocol Discovery for the Quantum Control of Majoranas by Differentiable Programming and Natural Evolution Strategies
• Near-optimal control of dynamical systems with neural ordinary differential equations
• Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
• Quantum optimal control in quantum technologies. Strategic report on current status, visions and goals for research in Europe
• Quantum sensing of a quantum field
• Performance Bounds for Quantum Feedback Control