Learning in Quantum Control: High-Dimensional Global Optimization for Noisy Quantum Dynamics

Abstract

Quantum control is valuable for various quantum technologies such as high-fidelity gates for universal quantum computing, adaptive quantum-enhanced metrology, and ultra-cold atom manipulation. Although supervised machine learning and reinforcement learning are widely used for optimizing control parameters in classical systems, quantum control for parameter optimization is mainly pursued via gradient-based greedy algorithms. Although the quantum fitness landscape is often compatible with greedy algorithms, sometimes greedy algorithms yield poor results, especially for large-dimensional quantum systems. We employ differential evolution algorithms to circumvent the stagnation problem of non-convex optimization. We improve quantum control fidelity for noisy system by averaging over the objective function. To reduce computational cost, we introduce heuristics for early termination of runs and for adaptive selection of search subspaces. Our implementation is massively parallel and vectorized to reduce run time even further. We demonstrate our methods with two examples, namely quantum phase estimation and quantum gate design, for which we achieve superior fidelity and scalability than obtained using greedy algorithms.

arXiv comment32 pages, 4 figures, extension of proceedings in ESANN 2016 conference submitted to Neurocomputing

References in corpus (49)

• Observation of Gravitational Waves from a Binary Black Hole Merger
• Polynomial-Time Algorithms for Prime Factorization and Discrete Logarithms on a Quantum Computer
• Elementary gates for quantum computation
• Advances in Quantum Metrology
• The Security of Practical Quantum Key Distribution
• Quantum metrology from a quantum information science perspective
• Quantum control theory and applications: A survey
• Realization of Three-Qubit Quantum Error Correction with Superconducting Circuits
• Suppressing Charge Noise Decoherence in Superconducting Charge Qubits
• Quantum feedback control of a superconducting qubit: Persistent Rabi oscillations
• Quantum Circuits for General Multiqubit Gates
• Implementation of a Toffoli Gate with Superconducting Circuits
• Quantum feedback control and classical control theory
• Realization of the quantum Toffoli gate with trapped ions
• Optomechanical Cooling of a Macroscopic Oscillator by Homodyne Feedback
• Adaptive homodyne measurement of optical phase
• Optimal states and almost optimal adaptive measurements for quantum interferometry
• Experimental Implementation of Discrete Time Quantum Random Walk on an NMR Quantum Information Processor
• Continuous quantum error correction via quantum feedback control
• Modeling and Control of Quantum Systems: An Introduction
• Stabilizing feedback controls for quantum systems
• Fast machine-learning online optimization of ultra-cold-atom experiments
• Machine Learning for Precise Quantum Measurement
• Feedback cooling of a nanomechanical resonator
• Fidelity-based Probabilistic Q-learning for Control of Quantum Systems
• Bayesian feedback versus Markovian feedback in a two-level atom
• Machine learning for discriminating quantum measurement trajectories and improving readout
• Stabilization of Ultracold Molecules Using Optimal Control Theory
• High-Fidelity Single-Shot Toffoli Gate via Quantum Control
• Bounding quantum gate error rate based on reported average fidelity
• Squeezing of a nanomechanical resonator by quantum nondemolition measurement and feedback
• An Efficient Algorithm for Optimizing Adaptive Quantum Metrology Processes
• Evolutionary Algorithms for Hard Quantum Control
• Near Heisenberg limited atomic clocks in the presence of decoherence
• Designing High-Fidelity Single-Shot Three-Qubit Gates: A Machine Learning Approach
• Ultimate limits to quantum metrology and the meaning of the Heisenberg limit
• Optimal quantum control of Bose-Einstein condensates in magnetic microtraps: Comparison of GRAPE and Krotov optimization schemes
• Quantum gate learning in engineered qubit networks: Toffoli gate with always-on interactions
• Experimental Demonstration of Adaptive Quantum State Estimation
• Adaptive single-shot phase measurements: The full quantum theory
• Differential Evolution for Many-Particle Adaptive Quantum Metrology
• Using Recurrent Neural Networks to Optimize Dynamical Decoupling for Quantum Memory
• Adaptive quantum computation in changing environments using projective simulation
• Implementing quantum logic gates with GRAPE: principles and practicalities
• Quantum learning: optimal classification of qubit states
• Adaptive Measurements in the Optical Quantum Information Laboratory
• Robust Adaptive Quantum Phase Estimation
• Quantum Information Science: Emerging No More
• Spin bath narrowing with adaptive parameter estimation

Cited by in corpus (54)

• Quantum Machine Learning
• Quantum generalisation of feedforward neural networks
• Machine Learning Topological Invariants with Neural Networks
• Reinforcement Learning with Neural Networks for Quantum Feedback
• Artificial Intelligence and Machine Learning for Quantum Technologies
• Learning-based Quantum Robust Control: Algorithm, Applications and Experiments
• Multiparameter optimisation of a magneto-optical trap using deep learning
• Optimal Scheme for Quantum Metrology
• Quantum circuit optimization with deep reinforcement learning
• Remote optimization of an ultra-cold atoms experiment by experts and citizen scientists
• Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements
• Learning quantum data with the quantum Earth Mover's distance
• QuanEstimation: An open-source toolkit for quantum parameter estimation
• Quantum optimal control of multi-level dissipative quantum systems with Reinforcement Learning
• Improving the dynamics of quantum sensors with reinforcement learning
• Neural-Network Heuristics for Adaptive Bayesian Quantum Estimation
• Machine learning \& artificial intelligence in the quantum domain
• Robust calibration of multiparameter sensors via machine learning at the single-photon level
• Quantum Architecture Search via Deep Reinforcement Learning
• Deep Reinforcement Learning for Efficient Measurement of Quantum Devices
• Approaching the adiabatic timescale with machine-learning
• Optimal quantum control with poor statistics
• Hessian-based optimization of constrained quantum control
• Bilinear dynamic mode decomposition for quantum control
• Robust quantum gates using smooth pulses and physics-informed neural networks
• Stochastic Estimation of Dynamical Variables
• Robustness of Quantum-Enhanced Adaptive Phase Estimation
• Quantum control for high-fidelity multi-qubit gates
• Efficient and Robust Entanglement Generation with Deep Reinforcement Learning for Quantum Metrology
• Learning control of quantum systems using frequency-domain optimization algorithms
• Machine-learning assisted quantum control in random environment
• Preparation of ordered states in ultra-cold gases using Bayesian optimization
• Feedback Ansatz for Adaptive-Feedback Quantum Metrology Training with Machine Learning
• Benchmarking Machine Learning Algorithms for Adaptive Quantum Phase Estimation with Noisy Intermediate-Scale Quantum Sensors
• Quantum reinforcement learning in continuous action space
• Uncomputability and complexity of quantum control
• Optimal quantum control via genetic algorithms for quantum state engineering in driven-resonator mediated networks
• Fast, high precision dynamics in quantum optimal control theory
• Global optimization for quantum dynamics of few-fermion systems
• In situ upgrade of quantum simulators to universal computers
• Machine learning applied to quantum synchronization-assisted probing
• Framework for Learning and Control in the Classical and Quantum Domains
• Generation of True Quantum Random Numbers with On-Demand Probability Distributions via Single-Photon Quantum Walks
• Algorithmic Primitives for Quantum-Assisted Quantum Control
• Learning Simon's quantum algorithm
• Achieving Heisenberg limit under General Markov Noise without Ancilla
• Supercomputer simulations of transmon quantum computers
• Persistent Ballistic Entanglement Spreading with Optimal Control in Quantum Spin Chains
• Improved Tomographic Estimates by Specialised Neural Networks
• Quasi-adiabatic Grover search via the WKB approximation
• Quantum process matrices as images: new tools to design novel denoising methods
• Globally optimal control of quantum dynamics
• Robust Dynamical Decoupling for the Manipulation of a Spin Network via a Single Spin
• Reinforcement Learning with Neural Networks for Quantum Multiple Hypothesis Testing