Reinforcement learning approach to non-equilibrium quantum thermodynamics

Abstract

We use a reinforcement learning approach to reduce entropy production in a closed quantum system brought out of equilibrium. Our strategy makes use of an external control Hamiltonian and a policy gradient technique. Our approach bears no dependence on the quantitative tool chosen to characterize the degree of thermodynamic irreversibility induced by the dynamical process being considered, require little knowledge of the dynamics itself and does not need the tracking of the quantum state of the system during the evolution, thus embodying an experimentally non-demanding approach to the control of non-equilibrium quantum thermodynamics. We successfully apply our methods to the case of single- and two-particle systems subjected to time-dependent driving potentials.

References in corpus (44)

• SciPy 1.0--Fundamental Algorithms for Scientific Computing in Python
• A nonequilibrium equality for free energy differences
• The Entropy Production Fluctuation Theorem and the Nonequilibrium Work Relation for Free Energy Differences
• Machine learning phases of matter
• The Role of Relative Entropy in Quantum Information Theory
• Shortcuts to adiabaticity: concepts, methods, and applications
• Quantum Thermodynamics
• Fluctuation theorems: Work is not an observable
• Quantum heat engines and refrigerators: Continuous devices
• Experimental characterization of a spin quantum heat engine
• Reinforcement Learning in Different Phases of Quantum Control
• Active learning machine learns to create new quantum experiments
• More bang for your buck: Towards super-adiabatic quantum engines
• Measuring the characteristic function of the work distribution
• Generalized Clausius inequality for nonequilibrium quantum processes
• Quantum engine efficiency bound beyond the second law of thermodynamics
• Reinforcement Learning with Neural Networks for Quantum Feedback
• A spin heat engine coupled to a harmonic-oscillator flywheel
• Nonequilibrium entropy production for open quantum systems
• Squeezed thermal reservoirs as a resource for a nano-mechanical engine beyond the Carnot limit
• Constructing neural stationary states for open quantum many-body systems
• Quantum thermal absorption machines: refrigerators, engines and clocks
• Adiabatic tracking of quantum many-body dynamics
• Machine learning-based classification of vector vortex beams
• Shortcut to Adiabaticity in the Lipkin-Meshkov-Glick Model
• When does reinforcement learning stand out in quantum control? A comparative study on state preparation
• Superadiabatic Controlled Evolutions and Universal Quantum Computation
• Experimental engineering of arbitrary qudit states with discrete-time quantum walks
• Superadiabatic quantum friction suppression in finite-time thermodynamics
• Cost of counterdiabatic driving and work output
• Performance of superadiabatic quantum machines
• Spin quantum heat engines with shortcuts to adiabaticity
• Performance of shortcut-to-adiabaticity quantum engines
• Coherent Transport of Quantum States by Deep Reinforcement Learning
• Shortcut-to-adiabaticity Otto engine: A twist to finite-time thermodynamics
• Modelling Non-Markovian Quantum Processes with Recurrent Neural Networks
• Entanglement Classification via Neural Network Quantum States
• Quantum phase recognition via unsupervised machine learning
• Shortcut-to-adiabaticity quantum Otto refrigerator
• Shortcuts to adiabaticity in the strongly-coupled regime: nonadiabatic control of a unitary Fermi gas
• Fast state transfer in a Λ-system: a shortcut-to-adiabaticity approach to robust and resource optimized control
• Ultra-cold Single-Atom Quantum Heat Engines
• Supervised learning of time-independent Hamiltonians for gate design
• Shortcuts to adiabaticity for an ion in a rotating radially-tight trap

Cited by in corpus (34)

• Identifying optimal cycles in quantum thermal machines with reinforcement-learning
• Spin Quantum Heat Engine Quantified by Quantum Steering
• A Tutorial on Optimal Control and Reinforcement Learning methods for Quantum Technologies
• Optimal control of quantum thermal machines using machine learning
• Reinforcement learning optimization of the charging of a Dicke quantum battery
• Reinforcement learning-enhanced protocols for coherent population-transfer in three-level quantum systems
• Pareto-optimal cycles for power, efficiency and fluctuations of quantum heat engines using reinforcement learning
• Many-body enhancement in a spin-chain quantum heat engine
• Quantum Thermodynamics and Quantum Coherence Engines
• Optimal Thermometers with Spin Networks
• Spectral Density Classification For Environment Spectroscopy
• Dissipation-induced collective advantage of a quantum thermal machine
• Machine classification for probe based quantum thermometry
• Optimal quantum control via genetic algorithms for quantum state engineering in driven-resonator mediated networks
• Model-free optimization of power/efficiency tradeoffs in quantum thermal machines using reinforcement learning
• Finite-time two-spin quantum Otto engines: shortcuts to adiabaticity vs. irreversibility
• Optimal control of dissipation and work fluctuations for rapidly driven systems
• Deep reinforcement learning for preparation of thermal and prethermal quantum states
• Exploring the Optimal Cycle for Quantum Heat Engine using Reinforcement Learning
• Nonequilibrium Quantum Thermodynamics in Non-Markovian Adiabatic Speedup
• Bidirectional deep learning of polarization transfer in liquid crystals with application to quantum state preparation
• Reinforcement Learning Approach to Shortcuts between Thermodynamic States with Extra Constraints
• Noise Classification in Three-Level Quantum Networks by Machine Learning
• Characterization of a driven two-level quantum system by Supervised Learning
• Artificially intelligent Maxwell's demon for optimal control of open quantum systems
• Gaussian boson sampling and multi-particle event optimization by machine learning in the quantum phase space
• Machine learning non-Markovian two-level quantum noise spectroscopy
• Detecting Markovianity of Quantum Processes via Recurrent Neural Networks
• Towards neural reinforcement learning for large deviations in nonequilibrium systems with memory
• A Testable Theory for The Emergence of the Classical World
• Fully differentiable optimization protocols for non-equilibrium steady states
• Multiclass classification of dephasing channels
• Reinforcement Learning with Neural Networks for Quantum Multiple Hypothesis Testing
• Orthogonalization speed-up from quantum coherence after a sudden quench