Identifying optimal cycles in quantum thermal machines with reinforcement-learning

Abstract

The optimal control of open quantum systems is a challenging task but has a key role in improving existing quantum information processing technologies. We introduce a general framework based on Reinforcement Learning to discover optimal thermodynamic cycles that maximize the power of out-of-equilibrium quantum heat engines and refrigerators. We apply our method, based on the soft actor-critic algorithm, to three systems: a benchmark two-level system heat engine, where we find the optimal known cycle; an experimentally realistic refrigerator based on a superconducting qubit that generates coherence, where we find a non-intuitive control sequence that outperform previous cycles proposed in literature; a heat engine based on a quantum harmonic oscillator, where we find a cycle with an elaborate structure that outperforms the optimized Otto cycle. We then evaluate the corresponding efficiency at maximum power.

arXiv comment7+8 pages, 7 figures

References in corpus (82)

• Adam: A Method for Stochastic Optimization
• Circuit Quantum Electrodynamics: Coherent Coupling of a Single Photon to a Cooper Pair Box
• Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor
• Quantifying Coherence
• Soft Actor-Critic Algorithms and Applications
• Opportunities for mesoscopics in thermometry and refrigeration: Physics and applications
• Quantum Thermodynamics
• Quantum Thermodynamics
• Quantum Thermodynamic Cycles and quantum heat engines
• A single-atom heat engine
• Concepts and methods in the theory of open quantum systems
• Shortcuts to adiabaticity
• Efficiency at maximum power: An analytically solvable model for stochastic heat engines
• Efficiency at maximum power of low dissipation Carnot engines
• Single ion heat engine with maximum efficiency at maximum power
• Experimental demonstration of quantum effects in the operation of microscopic heat engines
• Quantum Equivalence and Quantum Signatures in Heat Engines
• Experimental characterization of a spin quantum heat engine
• The quantum harmonic Otto cycle
• Irreversible Performance of a Quantum Harmonic Heat Engine
• Thermoelectric efficiency at maximum power in a quantum dot
• A quantum-dot heat engine operating close to the thermodynamic efficiency limits
• More bang for your buck: Towards super-adiabatic quantum engines
• The power of a critical heat engine
• Performance of discrete heat engines and heat pumps in finite time
• Quantum Optomechanical Heat Engine
• Quantum absorption refrigerator with trapped ions
• Quantum-dot Carnot engine at maximum power
• Tunable photonic heat transport in a quantum heat valve
• A spin heat engine coupled to a harmonic-oscillator flywheel
• Soft Actor-Critic for Discrete Action Settings
• Nonequilibrium fluctuations in quantum heat engines: Theory, example, and possible solid state experiments
• Quantum Supremacy of Many-Particle Thermal Machines
• Slow dynamics and thermodynamics of open quantum systems
• Otto refrigerator based on a superconducting qubit: classical and quantum performance
• A Discrete Four Stroke Quantum Heat Engine Exploring the Origin of Friction
• Carnot Cycle at Finite Power: Attainability of Maximal Efficiency
• Boosting work characteristics and overall heat engine performance via shortcuts to adiabaticity: quantum and classical systems
• Optimal cycles for low-dissipation heat engines
• When does reinforcement learning stand out in quantum control? A comparative study on state preparation
• Strong coupling corrections in quantum thermodynamics
• Deep Reinforcement Learning for Quantum Gate Control
• Universal Coherence-Induced Power Losses of Quantum Heat Engines in Linear Response
• Efficiency of harmonic quantum Otto engines at maximal power
• Quantum Performance of Thermal Machines over Many Cycles
• Strongly coupled quantum heat machines
• Superadiabatic quantum friction suppression in finite-time thermodynamics
• Time Dependent Markovian Quantum Master Equation
• Spin quantum heat engines with shortcuts to adiabaticity
• Adiabatic response and quantum thermoelectrics for ac driven quantum systems
• Heat production and energy balance in nanoengines driven by time-dependent fields
• Global optimization of quantum dynamics with AlphaZero deep exploration
• Geometric optimisation of quantum thermodynamic processes
• Quantum Signatures in the Quantum Carnot Cycle
• Single atom energy-conversion device with a quantum load
• Thermoelectric properties of an interacting quantum dot-based heat engine
• Thermoelectric performance of a driven double quantum dot
• Thermoelectric conversion at 30K in InAs/InP nanowire quantum dots
• Thermal machines beyond the weak coupling regime
• Direct measurement of the Seebeck coefficient in a Kondo-correlated single-quantum-dot transistor
• Geometric properties of adiabatic quantum thermal machines
• Reinforcement Learning Decoders for Fault-Tolerant Quantum Computation
• Adiabatic theorems for generators of contracting evolutions
• Markovian Quantum Master Equation beyond Adiabatic Regime
• Non-Markov Enhancement of Maximum Power for Quantum Thermal Machines
• Maximum power and corresponding efficiency for two-level heat engines and refrigerators: optimality of fast cycles
• Single-atom heat machines enabled by energy quantization
• A Reinforcement Learning approach for Quantum State Engineering
• Reinforcement learning approach to non-equilibrium quantum thermodynamics
• Swift heat transfer by fast-forward driving in open quantum systems
• Optimal thermodynamic control in open quantum systems
• Stroboscopic two-stroke quantum heat engines
• Speeding-up a quantum refrigerator via counter-diabatic driving
• Boosting the performance of the Quantum Otto heat engines
• Discrete and Continuous Action Representation for Practical RL in Video Games
• Electric field control of radiative heat transfer in a superconducting circuit
• Supremacy of incoherent sudden cycles
• Quantum thermodynamics with local control
• Speeding up Thermalisation via Open Quantum System Variational Optimisation
• Maximum power heat engines and refrigerators in the fast-driving regime
• Two-Stroke Optimization Scheme for Mesoscopic Refrigerators
• Machine classification for probe based quantum thermometry

Cited by in corpus (62)

• Quantum thermodynamic devices: from theoretical proposals to experimental reality
• Artificial Intelligence and Machine Learning for Quantum Technologies
• Quantum Engines and Refrigerators
• Scalable High-Performance Fluxonium Quantum Processor
• Energy dynamics, heat production and heat-work conversion with qubits: towards the development of quantum machines
• Experimental Realization of Two Qutrits Gate with Tunable Coupling in Superconducting Circuits
• Universal cost bound of quantum error mitigation based on quantum estimation theory
• Coexistence of nonequilibrium density and equilibrium energy distribution of quasiparticles in a superconducting qubit
• Chemical profiles of the oxides on tantalum in state of the art superconducting circuits
• The Ising critical quantum Otto engine
• Reinforcement learning optimization of the charging of a Dicke quantum battery
• Proposal for Observing Yang-Lee Criticality in Rydberg Atomic Arrays
• Pseudomagic Quantum States
• Collective advantages in finite-time thermodynamics
• Pareto-optimal cycles for power, efficiency and fluctuations of quantum heat engines using reinforcement learning
• Roadmap on Quantum Thermodynamics
• Multi-client distributed blind quantum computation with the Qline architecture
• Scalable and robust quantum computing on qubit arrays with fixed coupling
• Dynamical heat engines with non--Markovian reservoirs
• Hierarchical quantum circuit representations for neural architecture search
• Quadratic Enhancement in the Reliability of Collective Quantum Engines
• Controlling the Photon Number Coherence of Solid-state Quantum Light Sources for Quantum Cryptography
• Efficient and Robust Entanglement Generation with Deep Reinforcement Learning for Quantum Metrology
• Measurement-based quantum thermal machines with feedback control
• High-Coherence Kerr-cat qubit in 2D architecture
• Optimal Thermometers with Spin Networks
• Exact Results for a Boundary-Driven Double Spin Chain and Resource-Efficient Remote Entanglement Stabilization
• Dissipation-induced collective advantage of a quantum thermal machine
• Low-Loss Superconducting Resonators Fabricated from Tantalum Films Grown at Room Temperature
• Quantum Stirling heat engine with squeezed thermal reservoir
• Optimal Control in Disordered Quantum Systems
• Optimal finite-time heat engines under constrained control
• Decay-protected superconducting qubit with fast control enabled by integrated on-chip filters
• Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
• Experimental graybox quantum system identification and control
• Quantum Electrometer for Time-Resolved Material Science at the Atomic Lattice Scale
• Optimization of Asymmetric Quantum Otto Engine Cycles
• Bath engineering enhanced quantum critical engines
• Deep reinforcement learning for preparation of thermal and prethermal quantum states
• Near-term Efficient Quantum Algorithms for Entanglement Analysis
• Construction of various time-dependent Hamiltonians on a single photonic chip
• Dicke superradiant enhancement of the heat current in circuit QED
• Quantum Error Mitigation via Quantum-Noise-Effect Circuit Groups
• Exploring the Optimal Cycle for Quantum Heat Engine using Reinforcement Learning
• An RNN-policy gradient approach for quantum architecture search
• Coherence-based operational nonclassicality criteria
• Reversing Hydrogen-Related Loss in $\alpha$-Ta Thin Films for Quantum Device Fabrication
• Cavity-Heisenberg spin-$j$ chain quantum battery and reinforcement learning optimization
• Spectral Signatures of Non-Trivial Topology in a Superconducting Circuit
• Quantum optimal control in quantum technologies. Strategic report on current status, visions and goals for research in Europe
• The promises and challenges of many-body quantum technologies: a focus on quantum engines
• Characterization of a driven two-level quantum system by Supervised Learning
• A spinless spin qubit
• Reservoir-Free Decoherence in Flying Qubits
• Effect of Decoherence for Gate Operations on a Superconducting Bosonic Qubit
• Artificially intelligent Maxwell's demon for optimal control of open quantum systems
• Preparing Quantum States by Measurement-feedback Control with Bayesian Optimization
• Machine learning delta-T noise for temperature bias estimation
• Stochastic Thermodynamics at the Quantum-Classical Boundary: A Self-Consistent Framework Based on Adiabatic-Response Theory
• High temporal stability of niobium superconducting resonators by surface passivation with organophosphonate self-assembled monolayers
• No-Collapse Accurate Quantum Feedback Control via Conditional State Tomography
• Geometric Bounds on the Power of Adiabatic Thermal Machines