Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
arXiv:2204.04785 · doi:10.1093/pnasnexus/pgad248
Abstract
A quantum thermal machine is an open quantum system that enables the conversion between heat and work at the micro or nano-scale. Optimally controlling such out-of-equilibrium systems is a crucial yet challenging task with applications to quantum technologies and devices. We introduce a general model-free framework based on Reinforcement Learning to identify out-of-equilibrium thermodynamic cycles that are Pareto optimal trade-offs between power and efficiency for quantum heat engines and refrigerators. The method does not require any knowledge of the quantum thermal machine, nor of the system model, nor of the quantum state. Instead, it only observes the heat fluxes, so it is both applicable to simulations and experimental devices. We test our method on a model of an experimentally realistic refrigerator based on a superconducting qubit, and on a heat engine based on a quantum harmonic oscillator. In both cases, we identify the Pareto-front representing optimal power-efficiency tradeoffs, and the corresponding cycles. Such solutions outperform previous proposals made in the literature, such as optimized Otto cycles, reducing quantum friction.
arXiv comment7+13 pages, 9 figures. arXiv admin note: text overlap with arXiv:2108.13525
References in corpus (83)
- Quantifying Coherence
- A Quantum Engineer's Guide to Superconducting Qubits
- Opportunities for mesoscopics in thermometry and refrigeration: Physics and applications
- Thermodynamic uncertainty relation for biomolecular processes
- Quantum Thermodynamics
- Quantum Thermodynamic Cycles and quantum heat engines
- A single-atom heat engine
- Fundamental aspects of steady-state conversion of heat to work at the nanoscale
- Shortcuts to adiabaticity
- Efficiency at maximum power of low dissipation Carnot engines
- Single ion heat engine with maximum efficiency at maximum power
- Experimental demonstration of quantum effects in the operation of microscopic heat engines
- Experimental characterization of a spin quantum heat engine
- The quantum harmonic Otto cycle
- Irreversible Performance of a Quantum Harmonic Heat Engine
- A quantum-dot heat engine operating close to the thermodynamic efficiency limits
- More bang for your buck: Towards super-adiabatic quantum engines
- The power of a critical heat engine
- Performance of discrete heat engines and heat pumps in finite time
- Quantum Optomechanical Heat Engine
- Quantum absorption refrigerator with trapped ions
- Quantum-dot Carnot engine at maximum power
- Tunable photonic heat transport in a quantum heat valve
- Reinforcement Learning with Neural Networks for Quantum Feedback
- A spin heat engine coupled to a harmonic-oscillator flywheel
- Nonequilibrium thermodynamics in the strong coupling and non-Markovian regime based on a reaction coordinate mapping
- Nonequilibrium fluctuations in quantum heat engines: Theory, example, and possible solid state experiments
- Thermodynamics of precision in quantum non equilibrium steady states
- Slow dynamics and thermodynamics of open quantum systems
- Otto refrigerator based on a superconducting qubit: classical and quantum performance
- A Discrete Four Stroke Quantum Heat Engine Exploring the Origin of Friction
- Carnot Cycle at Finite Power: Attainability of Maximal Efficiency
- Boosting work characteristics and overall heat engine performance via shortcuts to adiabaticity: quantum and classical systems
- Optimal cycles for low-dissipation heat engines
- When does reinforcement learning stand out in quantum control? A comparative study on state preparation
- Deep Reinforcement Learning for Quantum Gate Control
- Universal Coherence-Induced Power Losses of Quantum Heat Engines in Linear Response
- Thermodynamic length in open quantum systems
- Thermodynamic uncertainty relation in slowly driven quantum heat engines
- Identifying optimal cycles in quantum thermal machines with reinforcement-learning
- Efficiency of harmonic quantum Otto engines at maximal power
- Work fluctuations in slow processes: quantum signatures and optimal control
- Quantum Performance of Thermal Machines over Many Cycles
- Superadiabatic quantum friction suppression in finite-time thermodynamics
- Time Dependent Markovian Quantum Master Equation
- Spin quantum heat engines with shortcuts to adiabaticity
- Adiabatic response and quantum thermoelectrics for ac driven quantum systems
- Heat production and energy balance in nanoengines driven by time-dependent fields
- Global optimization of quantum dynamics with AlphaZero deep exploration
- Geometric optimisation of quantum thermodynamic processes
- Quantum Signatures in the Quantum Carnot Cycle
- Single atom energy-conversion device with a quantum load
- Thermoelectric performance of a driven double quantum dot
- Thermoelectric conversion at 30K in InAs/InP nanowire quantum dots
- Deep Reinforcement Learning for Quantum State Preparation with Weak Nonlinear Measurements
- Geometric properties of adiabatic quantum thermal machines
- Direct measurement of the Seebeck coefficient in a Kondo-correlated single-quantum-dot transistor
- Adiabatic theorems for generators of contracting evolutions
- Phase transition in protocols minimizing work fluctuations
- Markovian Quantum Master Equation beyond Adiabatic Regime
- Non-Markov Enhancement of Maximum Power for Quantum Thermal Machines
- Single-atom heat machines enabled by energy quantization
- A Reinforcement Learning approach for Quantum State Engineering
- Swift heat transfer by fast-forward driving in open quantum systems
- Reinforcement learning approach to non-equilibrium quantum thermodynamics
- A differentiable programming method for quantum control
- A quantum enhanced finite-time Otto cycle
- Stroboscopic two-stroke quantum heat engines
- Optimal thermodynamic control in open quantum systems
- Speeding-up a quantum refrigerator via counter-diabatic driving
- Boosting the performance of the Quantum Otto heat engines
- Electric field control of radiative heat transfer in a superconducting circuit
- Reinforcement learning-enhanced protocols for coherent population-transfer in three-level quantum systems
- When is a quantum heat engine quantum?
- Supremacy of incoherent sudden cycles
- Quantum thermodynamics with local control
- Speeding up Thermalisation via Open Quantum System Variational Optimisation
- Maximum power heat engines and refrigerators in the fast-driving regime
- Dynamical heat engines with non--Markovian reservoirs
- Two-Stroke Optimization Scheme for Mesoscopic Refrigerators
- Extracting work from random collisions: A model of a quantum heat engine
- Control of Stochastic Quantum Dynamics by Differentiable Programming
- Geometric Bounds on the Power of Adiabatic Thermal Machines
Cited by in corpus (8)
- Reinforcement learning optimization of the charging of a Dicke quantum battery
- Artificial Intelligence for Quantum Computing
- Optimal Thermometers with Spin Networks
- Dissipation-induced collective advantage of a quantum thermal machine
- Experimental graybox quantum system identification and control
- Exploring the Optimal Cycle for Quantum Heat Engine using Reinforcement Learning
- Artificially intelligent Maxwell's demon for optimal control of open quantum systems
- Machine learning delta-T noise for temperature bias estimation