A differentiable programming method for quantum control

Abstract

Optimal control is highly desirable in many current quantum systems, especially to realize tasks in quantum information processing. We introduce a method based on differentiable programming to leverage explicit knowledge of the differential equations governing the dynamics of the system. In particular, a control agent is represented as a neural network that maps the state of the system at a given time to a control pulse. The parameters of this agent are optimized via gradient information obtained by direct differentiation through both the neural network \emph{and} the differential equation of the system. This fully differentiable reinforcement learning approach ultimately yields time-dependent control parameters optimizing a desired figure of merit. We demonstrate the method's viability and robustness to noise in eigenstate preparation tasks for three systems: a~single qubit, a~chain of qubits, and a quantum parametric oscillator.

arXiv comment21 pages, 9 figures

References in corpus (32)

• Adam: A Method for Stochastic Optimization
• Quantum secret sharing
• Trust Region Policy Optimization
• High-Dimensional Continuous Control Using Generalized Advantage Estimation
• Quantum Circuit Learning
• Parameterized quantum circuits as machine learning models
• Training Schrödinger's cat: quantum optimal control
• A Multiparticle Generalization of Entanglement Swapping
• Dynamically protected cat-qubits: a new paradigm for universal quantum computation
• Quantum control theory and applications: A survey
• Neural Ordinary Differential Equations
• Macroscopically distinct quantum superposition states as a bosonic code for amplitude damping
• Optimal control technique for Many Body Quantum Systems dynamics
• Chopped random-basis quantum optimization
• Reinforcement Learning in Different Phases of Quantum Control
• Model-Ensemble Trust-Region Policy Optimization
• Differentiable Programming Tensor Networks
• Reinforcement Learning with Neural Networks for Quantum Feedback
• Exact steady state of a Kerr resonator with one- and two-photon driving and dissipation: Controllable Wigner-function multimodality and dissipative phase transitions
• Multiconfigurational time-dependent Hartree approaches for indistinguishable particles
• Sampling-based learning control of inhomogeneous quantum ensembles
• Speedup for quantum optimal control from automatic differentiation based on graphics processing units
• Learning Robust and High-Precision Quantum Controls
• Out of equilibrium dynamics with Matrix Product States
• Using a Recurrent Neural Network to Reconstruct Quantum Dynamics of a Superconducting Qubit from Physical Observations
• Gradient-based optimal control of open quantum systems using quantum trajectories and automatic differentiation
• Quantum dynamics of a few-photon parametric oscillator
• Reinforcement learning for autonomous preparation of Floquet-engineered states: Inverting the quantum Kapitza oscillator
• A Data-Driven Gradient Algorithm for High-Precision Quantum Control
• Robust and efficient in situ quantum control
• Stochastic Estimation of Dynamical Variables
• Spectral Structure and Many-Body Dynamics of Ultracold Bosons in a Double-Well

Cited by in corpus (36)

• Artificial Intelligence and Machine Learning for Quantum Technologies
• Learning Quantum Systems
• Machine Learning for Quantum Matter
• Machine learning for long-distance quantum communication
• Learning neural network potentials from experimental data via Differentiable Trajectory Reweighting
• Quantum Machine Learning: from physics to software engineering
• Reinforcement Learning for Many-Body Ground-State Preparation Inspired by Counterdiabatic Driving
• Quantum machine learning and quantum biomimetics: A perspective
• Neural-Network Heuristics for Adaptive Bayesian Quantum Estimation
• Optimal control of quantum thermal machines using machine learning
• Gradient Ascent Pulse Engineering with Feedback
• Pareto-optimal cycles for power, efficiency and fluctuations of quantum heat engines using reinforcement learning
• Policy Gradient based Quantum Approximate Optimization Algorithm
• Quantum Optimal Control via Semi-Automatic Differentiation
• Protocol Discovery for the Quantum Control of Majoranas by Differentiable Programming and Natural Evolution Strategies
• Efficient and Robust Entanglement Generation with Deep Reinforcement Learning for Quantum Metrology
• Lie-algebraic classical simulations for quantum computing
• Towards learning optimized kernels for complex Langevin
• Control of Stochastic Quantum Dynamics by Differentiable Programming
• Energy control in a quantum oscillator using coherent control and engineered environment
• Frequentist Parameter Estimation with Supervised Learning
• Optimal Control in Disordered Quantum Systems
• Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
• Robust optimization for quantum reinforcement learning control using partial observations
• Qsun: an open-source platform towards practical quantum machine learning applications
• Noise-Robust End-to-End Quantum Control using Deep Autoregressive Policy Networks
• Certification of genuine multipartite entanglement in spin ensembles with measurements of total angular momentum
• Differentiable master equation solver for quantum device characterisation
• Persistent Ballistic Entanglement Spreading with Optimal Control in Quantum Spin Chains
• Fast Laser Cooling Using Optimal Quantum Control
• Differentiable Spline Approximations
• Robust implicit quantum control of interacting spin chains
• AbstractDifferentiation.jl: Backend-Agnostic Differentiable Programming in Julia
• Preparation of Many-body Ground States by Time Evolution with Variational Microscopic Magnetic Fields and Incomplete Interactions
• Reinforcement Learning with Neural Networks for Quantum Multiple Hypothesis Testing
• Fully differentiable optimization protocols for non-equilibrium steady states