Coherent Transport of Quantum States by Deep Reinforcement Learning

Abstract

Some problems in physics can be handled only after a suitable \textit{ansatz }solution has been guessed. Such method is therefore resilient to generalization, resulting of limited scope. The coherent transport by adiabatic passage of a quantum state through an array of semiconductor quantum dots provides a par excellence example of such approach, where it is necessary to introduce its so called counter-intuitive control gate ansatz pulse sequence. Instead, deep reinforcement learning technique has proven to be able to solve very complex sequential decision-making problems involving competition between short-term and long-term rewards, despite a lack of prior knowledge. We show that in the above problem deep reinforcement learning discovers control sequences outperforming the \textit{ansatz} counter-intuitive sequence. Even more interesting, it discovers novel strategies when realistic disturbances affect the ideal system, with better speed and fidelity when energy detuning between the ground states of quantum dots or dephasing are added to the master equation, also mitigating the effects of losses. This method enables online update of realistic systems as the policy convergence is boosted by exploiting the prior knowledge when available. Deep reinforcement learning proves effective to control dynamics of quantum states, and more generally it applies whenever an ansatz solution is unknown or insufficient to effectively treat the problem.

arXiv comment5 figures

References in corpus (32)

• QuTiP: An open-source Python framework for the dynamics of open quantum systems
• Shortcuts to adiabaticity
• A CMOS silicon spin qubit
• Charge noise and spin noise in a semiconductor quantum device
• Relaxation, dephasing, and quantum control of electron spins in double quantum dots
• Active learning machine learns to create new quantum experiments
• Exact mapping between system-reservoir quantum models and semi-infinite discrete chains using orthogonal polynomials
• Controlling open quantum systems: Tools, achievements, and limitations
• Spin transport and quasi 2D architectures for donor-based quantum computing
• Flow Navigation by Smart Microswimmers via Reinforcement Learning
• Efficient simulation of finite-temperature open quantum systems
• Fidelity-based Probabilistic Q-learning for Control of Quantum Systems
• Optimizing Quantum Error Correction Codes with Reinforcement Learning
• Quantum coherent biomolecular energy transfer with spatially correlated fluctuations
• When does reinforcement learning stand out in quantum control? A comparative study on state preparation
• One-by-one trap activation in silicon nanowire transistors
• Spatial adiabatic passage: a review of recent progress
• Basic protocols in quantum reinforcement learning with superconducting circuits
• A Reconfigurable Cryogenic Platform for the Classical Control of Scalable Quantum Computers
• Using Recurrent Neural Networks to Optimize Dynamical Decoupling for Quantum Memory
• Reconstruction of a Photonic Qubit State with Reinforcement Learning
• Measurement-based adaptation protocol with quantum reinforcement learning
• Spatial adiabatic passage in a realistic triple well structure
• Background charges and quantum effects in quantum dots transport spectroscopy
• Effective Hamiltonian for the hybrid double quantum dot qubit
• Relaxation and dephasing in open quantum systems time-dependent density functional theory: Properties of exact functionals from an exactly-solvable model system
• Coherent Tunneling by Adiabatic Passage of an exchange-only spin qubit in a double quantum dot chain
• Universal Set of Quantum Gates for Double-Dot Exchange-Only Spin Qubits with Intradot Coupling
• Fast long-range state transfer in quantum dot arrays via shortcuts to adiabaticity
• Dark State Adiabatic Passage with spin-one particles
• Measuring the Temperature of a Mesoscopic Quantum Electron System by means of Single Electron Statistics
• Finite Quantum Grand Canonical Ensemble and Temperature from Single Electron Statistics in a Mesoscopic Device

Cited by in corpus (49)

• Model-Free Quantum Control with Reinforcement Learning
• Experimental Deep Reinforcement Learning for Error-Robust Gateset Design on a Superconducting Quantum Computer
• Measurement Based Feedback Quantum Control With Deep Reinforcement Learning for Double-well Non-linear Potential
• Reinforcement Learning for Many-Body Ground-State Preparation Inspired by Counterdiabatic Driving
• Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements
• Deep Reinforcement Learning Control of Quantum Cartpoles
• A Tutorial on Optimal Control and Reinforcement Learning methods for Quantum Technologies
• A Reinforcement Learning approach for Quantum State Engineering
• Reinforcement learning approach to non-equilibrium quantum thermodynamics
• Quantum enhancements for deep reinforcement learning in large spaces
• Learning feedback control strategies for quantum metrology
• Breaking Adiabatic Quantum Control with Deep Learning
• Optimal control of quantum thermal machines using machine learning
• Gradient Ascent Pulse Engineering with Feedback
• Artificial Intelligence for Quantum Computing
• Reinforcement learning-enhanced protocols for coherent population-transfer in three-level quantum systems
• Classifying global state preparation via deep reinforcement learning
• Deep Reinforcement Learning for Efficient Measurement of Quantum Devices
• Is all-electrical silicon quantum computing feasible in the long term?
• Translating neutron star observations to nuclear symmetry energy via artificial neural networks
• Optimal control of families of quantum gates
• Photonic architecture for reinforcement learning
• Simultaneous multiple-users quantum communication across a spin chain channel
• CMOS Quantum Computing: Toward A Quantum Computer System-on-Chip
• Accurate phonon blockade detector composed of a quadratically coupled optomechanical system
• Optimal quantum control via genetic algorithms for quantum state engineering in driven-resonator mediated networks
• Quantum Logic Gate Synthesis as a Markov Decision Process
• Optimal Control in Disordered Quantum Systems
• Data-Centric Machine Learning in Quantum Information Science
• Machine Learning for Estimation and Control of Quantum Systems
• Robust optimization for quantum reinforcement learning control using partial observations
• Solving Rubik's Cube via Quantum Mechanics and Deep Reinforcement Learning
• Accelerated Magnonic Motional Cooling with Deep Reinforcement Learning
• Fast generation of entanglement between coupled spins using optimization and deep learning methods
• TorchQC -- A framework for efficiently integrating machine and deep learning methods in quantum dynamics and control
• Voltage-controlled Hubbard spin transistor
• Reinforcement learning assisted non-reciprocal optomechanical gyroscope
• Designing fast quantum gates using optimal control with a reinforcement-learning ansatz
• Reinforcement Learning Approach to Shortcuts between Thermodynamic States with Extra Constraints
• Quantum optimal control in quantum technologies. Strategic report on current status, visions and goals for research in Europe
• Multiparameter estimation of continuous-time Quantum Walk Hamiltonians through Machine Learning
• Characterization of a driven two-level quantum system by Supervised Learning
• Improving robustness of quantum feedback control with reinforcement learning
• Dropout is all you need: robust two-qubit gate with reinforcement learning
• Fast quantum gate design with deep reinforcement learning using real-time feedback on readout signals
• Deep reinforcement learning for feedback control in a collective flashing ratchet
• Quantum Compiling by Deep Reinforcement Learning
• No-Collapse Accurate Quantum Feedback Control via Conditional State Tomography
• Trade-off between Bagging and Boosting for quantum separability-entanglement classification