Identifying optimal cycles in quantum thermal machines with reinforcement-learning

Abstract

The optimal control of open quantum systems is a challenging task but has a key role in improving existing quantum information processing technologies. We introduce a general framework based on Reinforcement Learning to discover optimal thermodynamic cycles that maximize the power of out-of-equilibrium quantum heat engines and refrigerators. We apply our method, based on the soft actor-critic algorithm, to three systems: a benchmark two-level system heat engine, where we find the optimal known cycle; an experimentally realistic refrigerator based on a superconducting qubit that generates coherence, where we find a non-intuitive control sequence that outperform previous cycles proposed in literature; a heat engine based on a quantum harmonic oscillator, where we find a cycle with an elaborate structure that outperforms the optimized Otto cycle. We then evaluate the corresponding efficiency at maximum power.

7+8 pages, 7 figures

References in corpus (14)

• Quantum Thermodynamic Cycles and quantum heat engines
• Efficiency at maximum power: An analytically solvable model for stochastic heat engines
• Single ion heat engine with maximum efficiency at maximum power
• Soft Actor-Critic for Discrete Action Settings
• Nonequilibrium fluctuations in quantum heat engines: Theory, example, and possible solid state experiments
• Otto refrigerator based on a superconducting qubit: classical and quantum performance
• Deep Reinforcement Learning for Quantum Gate Control
• Quantum Performance of Thermal Machines over Many Cycles
• Thermoelectric conversion at 30K in InAs/InP nanowire quantum dots
• Non-Markov Enhancement of Maximum Power for Quantum Thermal Machines
• Speeding-up a quantum refrigerator via counter-diabatic driving
• Discrete and Continuous Action Representation for Practical RL in Video Games
• Two-Stroke Optimization Scheme for Mesoscopic Refrigerators
• Machine classification for probe based quantum thermometry

Cited by in corpus (62)

• Quantum thermodynamic devices: from theoretical proposals to experimental reality
• Artificial Intelligence and Machine Learning for Quantum Technologies
• Quantum Engines and Refrigerators
• Scalable High-Performance Fluxonium Quantum Processor
• Energy dynamics, heat production and heat-work conversion with qubits: towards the development of quantum machines
• Experimental Realization of Two Qutrits Gate with Tunable Coupling in Superconducting Circuits
• Universal cost bound of quantum error mitigation based on quantum estimation theory
• Coexistence of nonequilibrium density and equilibrium energy distribution of quasiparticles in a superconducting qubit
• Chemical profiles of the oxides on tantalum in state of the art superconducting circuits
• The Ising critical quantum Otto engine
• Reinforcement learning optimization of the charging of a Dicke quantum battery
• Proposal for Observing Yang-Lee Criticality in Rydberg Atomic Arrays
• Pseudomagic Quantum States
• Collective advantages in finite-time thermodynamics
• Pareto-optimal cycles for power, efficiency and fluctuations of quantum heat engines using reinforcement learning
• Roadmap on Quantum Thermodynamics
• Multi-client distributed blind quantum computation with the Qline architecture
• Scalable and robust quantum computing on qubit arrays with fixed coupling
• Dynamical heat engines with non--Markovian reservoirs
• Hierarchical quantum circuit representations for neural architecture search
• Quadratic Enhancement in the Reliability of Collective Quantum Engines
• Controlling the Photon Number Coherence of Solid-state Quantum Light Sources for Quantum Cryptography
• Efficient and Robust Entanglement Generation with Deep Reinforcement Learning for Quantum Metrology
• Measurement-based quantum thermal machines with feedback control
• High-Coherence Kerr-cat qubit in 2D architecture
• Optimal Thermometers with Spin Networks
• Exact Results for a Boundary-Driven Double Spin Chain and Resource-Efficient Remote Entanglement Stabilization
• Dissipation-induced collective advantage of a quantum thermal machine
• Low-Loss Superconducting Resonators Fabricated from Tantalum Films Grown at Room Temperature
• Quantum Stirling heat engine with squeezed thermal reservoir
• Optimal Control in Disordered Quantum Systems
• Optimal finite-time heat engines under constrained control
• Decay-protected superconducting qubit with fast control enabled by integrated on-chip filters
• Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
• Experimental graybox quantum system identification and control
• Quantum Electrometer for Time-Resolved Material Science at the Atomic Lattice Scale
• Optimization of Asymmetric Quantum Otto Engine Cycles
• Bath engineering enhanced quantum critical engines
• Deep reinforcement learning for preparation of thermal and prethermal quantum states
• Near-term Efficient Quantum Algorithms for Entanglement Analysis
• Construction of various time-dependent Hamiltonians on a single photonic chip
• Dicke superradiant enhancement of the heat current in circuit QED
• Quantum Error Mitigation via Quantum-Noise-Effect Circuit Groups
• Exploring the Optimal Cycle for Quantum Heat Engine using Reinforcement Learning
• An RNN-policy gradient approach for quantum architecture search
• Coherence-based operational nonclassicality criteria
• Reversing Hydrogen-Related Loss in $\alpha$-Ta Thin Films for Quantum Device Fabrication
• Cavity-Heisenberg spin-$j$ chain quantum battery and reinforcement learning optimization
• Spectral Signatures of Non-Trivial Topology in a Superconducting Circuit
• Quantum optimal control in quantum technologies. Strategic report on current status, visions and goals for research in Europe
• The promises and challenges of many-body quantum technologies: a focus on quantum engines
• Characterization of a driven two-level quantum system by Supervised Learning
• A spinless spin qubit
• Reservoir-Free Decoherence in Flying Qubits
• Effect of Decoherence for Gate Operations on a Superconducting Bosonic Qubit
• Artificially intelligent Maxwell's demon for optimal control of open quantum systems
• Preparing Quantum States by Measurement-feedback Control with Bayesian Optimization
• Machine learning delta-T noise for temperature bias estimation
• Stochastic Thermodynamics at the Quantum-Classical Boundary: A Self-Consistent Framework Based on Adiabatic-Response Theory
• High temporal stability of niobium superconducting resonators by surface passivation with organophosphonate self-assembled monolayers
• No-Collapse Accurate Quantum Feedback Control via Conditional State Tomography
• Geometric Bounds on the Power of Adiabatic Thermal Machines