Artificially intelligent Maxwell's demon for optimal control of open quantum systems
arXiv:2408.15328 · doi:10.1088/2058-9565/adbccf
Abstract
Feedback control of open quantum systems is of fundamental importance for practical applications in various contexts, ranging from quantum computation to quantum error correction and quantum metrology. Its use in the context of thermodynamics further enables the study of the interplay between information and energy. However, deriving optimal feedback control strategies is highly challenging, as it involves the optimal control of open quantum systems, the stochastic nature of quantum measurement, and the inclusion of policies that maximize a long-term time- and trajectory-averaged goal. In this work, we employ a reinforcement learning approach to automate and capture the role of a quantum Maxwell's demon: the agent takes the literal role of discovering optimal feedback control strategies in qubit-based systems that maximize a trade-off between measurement-powered cooling and measurement efficiency. Considering weak or projective quantum measurements, we explore different regimes based on the ordering between the thermalization, the measurement, and the unitary feedback timescales, finding different and highly non-intuitive, yet interpretable, strategies. In the thermalization-dominated regime, we find strategies with elaborate finite-time thermalization protocols conditioned on measurement outcomes. In the measurement-dominated regime, we find that optimal strategies involve adaptively measuring different qubit observables reflecting the acquired information, and repeating multiple weak measurements until the quantum state is "sufficiently pure", leading to random walks in state space. Finally, we study the case when all timescales are comparable, finding new feedback control strategies that considerably outperform more intuitive ones. We discuss a two-qubit example where we explore the role of entanglement and conclude discussing the scaling of our results to quantum many-body systems.
16+10 pages, 21 figures
References in corpus (126)
- QuTiP 2: A Python framework for the dynamics of open quantum systems
- Superconducting Qubits: Current State of Play
- Quantum computing with trapped ions
- Thermodynamic uncertainty relation for biomolecular processes
- Equilibration, thermalisation, and the emergence of statistical mechanics in closed quantum systems
- A single-atom heat engine
- Dissipation bounds all steady-state current fluctuations
- The Physics of Maxwell's demon and information
- Quantum feedback control of a superconducting qubit: Persistent Rabi oscillations
- Single ion heat engine with maximum efficiency at maximum power
- High-precision test of Landauer's principle in a feedback trap
- Brownian Carnot engine
- Minimal Energy Cost for Thermodynamic Information Processing: Measurement and Information Erasure
- Experimental realization of a Szilard engine with a single electron
- Universal trade-off between power, efficiency, and constancy in steady-state heat engines
- Observing single quantum trajectories of a superconducting qubit
- Experimental characterization of a spin quantum heat engine
- On-chip Maxwell's demon as an information-powered refrigerator
- Thermoelectric energy harvesting with quantum dots
- A quantum-dot heat engine operating close to the thermodynamic efficiency limits
- Reinforcement Learning in Different Phases of Quantum Control
- More bang for your buck: Towards super-adiabatic quantum engines
- The power of a critical heat engine
- Quantum feedback: theory, experiments, and applications
- Nonequilibrium Thermodynamics of Feedback Control
- Proof of the Finite-Time Thermodynamic Uncertainty Relation for Steady-State Currents
- Observing a quantum Maxwell demon at work
- Quantum absorption refrigerator with trapped ions
- Quantum-dot Carnot engine at maximum power
- A quantum-mechanical Maxwell's demon
- The physics of forgetting: Landauer's erasure principle and information theory
- A spin heat engine coupled to a harmonic-oscillator flywheel
- Reinforcement Learning with Neural Networks for Quantum Feedback
- Finite-time generalization of the thermodynamic uncertainty relation
- Extracting work from quantum measurement in Maxwell demon engines
- Mapping the optimal route between two quantum states
- Quantum technologies need a Quantum Energy Initiative
- Nonequilibrium fluctuations in quantum heat engines: Theory, example, and possible solid state experiments
- Quantum Measurement Cooling
- Discrete-time thermodynamic uncertainty relation
- Thermodynamics of precision in quantum non equilibrium steady states
- Experimental rectification of entropy production by a Maxwell's Demon in a quantum system
- Artificial Intelligence and Machine Learning for Quantum Technologies
- Thermodynamic Unification of Optimal Transport: Thermodynamic Uncertainty Relation, Minimum Dissipation, and Thermodynamic Speed Limits
- Cycling tames power fluctuations near optimum efficiency
- Unified thermodynamic uncertainty relations in linear response
- On the validity of the thermodynamic uncertainty relation in quantum systems
- Multidimensional thermodynamic uncertainty relations
- Machine Learning for Quantum Matter
- Optimal cycles for low-dissipation heat engines
- Efficient Quantum Measurement Engine
- Unifying Thermodynamic Uncertainty Relations
- When does reinforcement learning stand out in quantum control? A comparative study on state preparation
- A two-qubit engine fueled by entangling operations and local measurements
- Deep Reinforcement Learning for Quantum Gate Control
- Quantum Thermal Machine as a Thermometer
- Thermodynamic uncertainty relation in slowly driven quantum heat engines
- Identifying optimal cycles in quantum thermal machines with reinforcement-learning
- How to project qubits faster using quantum feedback
- Work fluctuations in slow processes: quantum signatures and optimal control
- Shortcut to Equilibration of an Open Quantum System
- An autonomous and reversible Maxwell's demon
- Thermodynamic uncertainty relations including measurement and feedback
- Bounds on current fluctuations in periodically driven systems
- Quantum Engines and Refrigerators
- Global optimization of quantum dynamics with AlphaZero deep exploration
- Measurement driven single temperature engine
- Quantum Signatures in the Quantum Carnot Cycle
- Geometric optimisation of quantum thermodynamic processes
- Thermoelectric performance of a driven double quantum dot
- Information and thermodynamics: fast and precise approach to Landauer's bound in an underdamped micro-mechanical oscillator
- Thermoelectric conversion at 30K in InAs/InP nanowire quantum dots
- Qubit feedback and control with kicked quantum nondemolition measurements: A quantum Bayesian analysis
- Quantum fluctuations hinder finite-time information erasure near the Landauer limit
- Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements
- Geometric properties of adiabatic quantum thermal machines
- Reinforcement Learning Decoders for Fault-Tolerant Quantum Computation
- Unifying speed limit, thermodynamic uncertainty relation and Heisenberg principle via bulk-boundary correspondence
- Thermally driven quantum refrigerator autonomously resets superconducting qubit
- Non-Markov Enhancement of Maximum Power for Quantum Thermal Machines
- Engineering Dynamical Sweet Spots to Protect Qubits from 1/ Noise
- Maximum power and corresponding efficiency for two-level heat engines and refrigerators: optimality of fast cycles
- Programmable Heisenberg interactions between Floquet qubits
- Information and thermodynamics: Experimental verification of Landauer's erasure principle
- Optimal probabilistic work extraction beyond the free energy difference with a single-electron device
- A Reinforcement Learning approach for Quantum State Engineering
- Swift heat transfer by fast-forward driving in open quantum systems
- Reinforcement learning approach to non-equilibrium quantum thermodynamics
- Thermodynamic uncertainty relations under arbitrary control protocols
- Realizing a deep reinforcement learning agent discovering real-time feedback control strategies for a quantum system
- Speed-ups to isothermality: Enhanced quantum thermal machines through control of the system-bath coupling
- Quantum field thermal machines
- Self-Correcting Quantum Many-Body Control using Reinforcement Learning with Tensor Networks
- Reinforcement learning optimization of the charging of a Dicke quantum battery
- Feedback controlled heat transport in quantum devices: Theory and solid state experimental proposal
- Arrow of Time for Continuous Quantum Measurement
- Detailed Fluctuation Relation for Arbitrary Measurement and Feedback Schemes
- Dynamics of information erasure and extension of Landauer's bound to fast processes
- Geometric optimization of non-equilibrium adiabatic thermal machines and implementation in a qubit system
- Reinforcement learning-enhanced protocols for coherent population-transfer in three-level quantum systems
- Nonequilibrium thermodynamics of erasure with superconducting flux logic
- Pareto-optimal cycles for power, efficiency and fluctuations of quantum heat engines using reinforcement learning
- Quantum Fokker-Planck Master Equation for Continuous Feedback Control
- Minimally dissipative information erasure in a quantum dot via thermodynamic length
- Measurement-driven navigation in many-body Hilbert space: Active-decision steering
- Maximum power heat engines and refrigerators in the fast-driving regime
- Single-Shot Readout of a Superconducting Qubit Using a Thermal Detector
- Minimal two-body quantum absorption refrigerator
- Thermodynamic uncertainty relation for energy transport in transient regime -- Model study
- Joint statistics of work and entropy production along quantum trajectories
- Informational steady-states and conditional entropy production in continuously monitored systems
- Non-Linear Thermovoltage in a Single-Electron Transistor
- Measurement-based quantum thermal machines with feedback control
- Vanishing efficiency of speeded-up quantum Otto engines
- Probing coherent quantum thermodynamics using a trapped ion
- Engineering unsteerable quantum states with active feedback
- Dissipation-induced collective advantage of a quantum thermal machine
- Thermodynamics of Quantum Measurement and the Demon's Arrow of Time
- Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
- A quantum Stirling heat engine operating in finite time
- Dilute measurement-induced cooling into many-body ground states
- Exploring the Optimal Cycle for Quantum Heat Engine using Reinforcement Learning
- Complexity-constrained quantum thermodynamics
- Informational steady-states and conditional entropy production in continuously monitored systems: the case of Gaussian systems
- Quantum Zeno Engines and Heat Pumps
- Efficiency and thermodynamic uncertainty relations of a dynamical quantum heat engine