Quantum feedback control with a transformer neural network architecture
arXiv:2411.19253 · doi:10.1103/m429-jy1j
Abstract
Attention-based neural networks such as transformers have revolutionized various fields such as natural language processing, genomics, and vision. Here, we demonstrate the use of transformers for quantum feedback control through both a supervised and reinforcement learning approach. In particular, due to the transformer's ability to capture long-range temporal correlations and training efficiency, we show that it can surpass some of the limitations of previous control approaches, e.g.~those based on recurrent neural networks trained using a similar approach or policy based reinforcement learning. We numerically show, for the example of state stabilization of a two-level system, that our bespoke transformer architecture can achieve near unit fidelity to a target state in a short time even in the presence of inefficient measurement and Hamiltonian perturbations that were not included in the training set as well as the control of non-Markovian systems. We also demonstrate that our transformer can perform energy minimization of non-integrable many-body quantum systems when trained for reinforcement learning tasks. Our approach can be used for quantum error correction, fast control of quantum states in the presence of colored noise, as well as real-time tuning, and characterization of quantum devices.
9 pages, 4 figures
References in corpus (28)
- Cavity quantum electrodynamics for superconducting electrical circuits: an architecture for quantum computation
- QuTiP 2: A Python framework for the dynamics of open quantum systems
- Non-Markovian dynamics in open quantum systems
- Shortcuts to adiabaticity: concepts, methods, and applications
- A Straightforward Introduction to Continuous Quantum Measurement
- Ballistic spreading of entanglement in a diffusive nonintegrable system
- Geometry and non-adiabatic response in quantum and classical systems
- Quantum feedback: theory, experiments, and applications
- Non-perturbative treatment of non-Markovian dynamics of open quantum systems
- Reinforcement Learning with Neural Networks for Quantum Feedback
- Environmental dynamics, correlations, and the emergence of noncanonical equilibrium states in open quantum systems
- Current fluctuations in open quantum systems: Bridging the gap between quantum continuous measurements and full counting statistics
- Bayesian feedback versus Markovian feedback in a two-level atom
- Model-Free Quantum Control with Reinforcement Learning
- Mappings of open quantum systems onto chain representations and Markovian embeddings
- Charging a quantum battery with linear feedback control
- Measurement Based Feedback Quantum Control With Deep Reinforcement Learning for Double-well Non-linear Potential
- Deep Reinforcement Learning Control of Quantum Cartpoles
- Non-Markovian quantum dynamics: What is it good for?
- Transformer Quantum State: A Multi-Purpose Model for Quantum Many-Body Problems
- Realizing a deep reinforcement learning agent discovering real-time feedback control strategies for a quantum system
- Self-Correcting Quantum Many-Body Control using Reinforcement Learning with Tensor Networks
- Gradient Ascent Pulse Engineering with Feedback
- Quantum-tailored machine-learning characterization of a superconducting qubit
- Quantifying quantum chaos through microcanonical distributions of entanglement
- Locally optimal measurement-based quantum feedback with application to multi-qubit entanglement generation
- Non-Markovian feedback for optimized quantum error correction
- Optimality of feedback control for qubit purification under inefficient measurement