Optimal control of quantum thermal machines using machine learning

Abstract

Identifying optimal thermodynamical processes has been the essence of thermodynamics since its inception. Here, we show that differentiable programming (DP), a machine learning (ML) tool, can be employed to optimize finite-time thermodynamical processes in a quantum thermal machine. We consider the paradigmatic quantum Otto engine with a time-dependent harmonic oscillator as its working fluid, and build upon shortcut-to-adiabaticity (STA) protocols. We formulate the STA driving protocol as a constrained optimization task and apply DP to find optimal driving profiles for an appropriate figure of merit. Our ML scheme discovers profiles for the compression and expansion strokes that are superior to previously-suggested protocols. Moreover, using our ML algorithm we show that a previously-employed, intuitive energetic cost of the STA driving suffers from a fundamental flaw, which we resolve with an alternative construction for the cost function. Our method and results demonstrate that ML is beneficial both for solving hard-constrained quantum control problems and for devising and assessing their theoretical groundwork.

arXiv comment5 pages + 5 figures, SM: 3 page + 1 figure. Comments are welcomed!

References in corpus (56)

• Shortcuts to adiabaticity: concepts, methods, and applications
• Quantum Thermodynamics
• Quantum Thermodynamics
• A single-atom heat engine
• Fast optimal frictionless atom cooling in harmonic traps
• Shortcuts to adiabaticity
• A nano heat engine beyond the Carnot limit
• Quantum heat engines and refrigerators: Continuous devices
• Efficiency at maximum power of low dissipation Carnot engines
• Shortcuts to adiabaticity by counter-diabatic driving
• Single ion heat engine with maximum efficiency at maximum power
• Optimal control technique for Many Body Quantum Systems dynamics
• Experimental demonstration of quantum effects in the operation of microscopic heat engines
• The quantum harmonic Otto cycle
• Irreversible Performance of a Quantum Harmonic Heat Engine
• Reinforcement Learning in Different Phases of Quantum Control
• More bang for your buck: Towards super-adiabatic quantum engines
• Active learning machine learns to create new quantum experiments
• Trade-off between speed and cost in shortcuts to adiabaticity
• Reinforcement Learning with Neural Networks for Quantum Feedback
• Quantum thermal machines and batteries
• Universal Work Fluctuations during Shortcuts To Adiabaticity by Counterdiabatic Driving
• Machine Learning for Quantum Matter
• Scaling-up quantum heat engines efficiently via shortcuts to adiabaticity
• Boosting work characteristics and overall heat engine performance via shortcuts to adiabaticity: quantum and classical systems
• Transient energy excitation in shortcuts to adiabaticity for the time dependent harmonic oscillator
• Superadiabatic Controlled Evolutions and Universal Quantum Computation
• Transitionless quantum drivings for the harmonic oscillator
• Machine learning for long-distance quantum communication
• Analog of a quantum heat engine using a single-spin qubit
• Finite time thermodynamics for a single level quantum dot
• Cost of counterdiabatic driving and work output
• The Quantum Refrigerator: The quest for absolute zero
• Performance of superadiabatic quantum machines
• Performance of shortcut-to-adiabaticity quantum engines
• Coherent Transport of Quantum States by Deep Reinforcement Learning
• Global optimization of quantum dynamics with AlphaZero deep exploration
• Optimal performance of a quantum Otto refrigerator
• Shortcut-to-adiabaticity Otto engine: A twist to finite-time thermodynamics
• Energy consumption for Shortcuts To Adiabaticity
• Deep Reinforcement Learning Control of Quantum Cartpoles
• Universal finite-time thermodynamics of many-body quantum machines from Kibble-Zurek scaling
• Reinforcement learning approach to non-equilibrium quantum thermodynamics
• Shortcut-to-adiabaticity quantum Otto refrigerator
• A differentiable programming method for quantum control
• A quantum enhanced finite-time Otto cycle
• Speeding-up a quantum refrigerator via counter-diabatic driving
• Deep Reinforcement Learning for Efficient Measurement of Quantum Devices
• Transient particle energies in shortcuts to adiabatic expansions of harmonic traps
• Protocol Discovery for the Quantum Control of Majoranas by Differentiable Programming and Natural Evolution Strategies
• Machine-learning-corrected quantum dynamics calculations
• Energy consumption for ion transport in a segmented Paul trap
• Vanishing efficiency of speeded-up quantum Otto engines
• Exact Delta Kick Cooling, Time-Optimal Control of Scale-Invariant Dynamics, and Shortcuts to Adiabaticity Assisted by Kicks
• Deep reinforcement learning for robust quantum optimization
• Optimizing thermodynamic trajectories using evolutionary and gradient-based reinforcement learning

Cited by in corpus (23)

• Quantum Engines and Refrigerators
• Counterdiabatic Optimised Local Driving
• Pareto-optimal cycles for power, efficiency and fluctuations of quantum heat engines using reinforcement learning
• Dynamical heat engines with non--Markovian reservoirs
• Quadratic Enhancement in the Reliability of Collective Quantum Engines
• Optimal Thermometers with Spin Networks
• Dissipation-induced collective advantage of a quantum thermal machine
• Optimal Control in Disordered Quantum Systems
• Counterdiabatic optimized driving in quantum phase sensitive models
• Optimal finite-time heat engines under constrained control
• Experimental graybox quantum system identification and control
• Bath engineering enhanced quantum critical engines
• Optimization of Asymmetric Quantum Otto Engine Cycles
• Exploring the Optimal Cycle for Quantum Heat Engine using Reinforcement Learning
• Multi-Axis Control of a Qubit in the Presence of Unknown Non-Markovian Quantum Noise
• Quantum optimal control in quantum technologies. Strategic report on current status, visions and goals for research in Europe
• Differentiable master equation solver for quantum device characterisation
• Parametrized multiqubit gate design for neutral-atom based quantum platforms
• Quantum compiling with a variational instruction set for accurate and fast quantum computing
• Preparing Quantum States by Measurement-feedback Control with Bayesian Optimization
• Machine learning delta-T noise for temperature bias estimation
• Stochastic Thermodynamics at the Quantum-Classical Boundary: A Self-Consistent Framework Based on Adiabatic-Response Theory
• Detecting Markovianity of Quantum Processes via Recurrent Neural Networks