Optimal Control of Underdamped Systems: An Analytic Approach

Abstract

Optimal control theory deals with finding protocols to steer a system between assigned initial and final states, such that a trajectory-dependent cost function is minimized. The application of optimal control to stochastic systems is an open and challenging research frontier, with a spectrum of applications ranging from stochastic thermodynamics to biophysics and data science. Among these, the design of nanoscale electronic components motivates the study of underdamped dynamics. In this work, we develop analytic techniques to determine protocols steering finite time transitions at a minimum thermodynamic cost for stochastic underdamped dynamics. As cost functions, we consider two paradigmatic thermodynamic indicators. The first is the Kullback-Leibler divergence between the probability measure of the controlled process and that of a reference process. The corresponding optimization problem is the underdamped version of the Schrödinger diffusion problem that has been widely studied in the overdamped regime. The second is the mean entropy production during the transition, corresponding to the second law of modern stochastic thermodynamics. For transitions between Gaussian states, we show that optimal protocols satisfy a Lyapunov equation, a central tool in stability analysis of dynamical systems. For transitions between states described by general Maxwell-Boltzmann distributions, we introduce an infinite-dimensional version of the Poincaré-Linstedt multiscale perturbation theory around the overdamped limit. This technique fundamentally improves the standard multiscale expansion. Indeed, it enables the explicit computation of momentum cumulants, whose variation in time is a distinctive trait of underdamped dynamics and is directly accessible to experimental observation.

arXiv comment74 pages, 8 figures

References in corpus (56)

• Shortcuts to adiabaticity: concepts, methods, and applications
• The Fluctuation Theorem as a Gibbs Property
• Brownian Carnot engine
• Superfluid transport of information in turning flocks of starlings
• Optimal finite-time processes in stochastic thermodynamics
• Levitodynamics: Levitation and control of microscopic objects in vacuum
• Second law and Landauer principle far from equilibrium
• Thermodynamic metrics and optimal paths
• Inertial effects of self-propelled particles: from active Brownian to active Langevin motion
• Command of active matter by topological defects and patterns
• Speed Limit for Classical Stochastic Processes
• Optimal protocols and optimal transport in stochastic thermodynamics
• Inertial delay of self-propelled particles
• Introduction to the Pontryagin Maximum Principle for Quantum Optimal Control
• Flocking and turning: a new model for self-organized collective motion
• Refined Second Law of Thermodynamics for fast random processes
• Engineered swift equilibration of a Brownian particle
• Reconstruction of the early Universe as a convex optimization problem
• Finite-time Landauer principle
• Optimal protocols for minimal work processes in underdamped stochastic thermodynamics
• Fluctuation Relations for Diffusion Processes
• Efficiency of molecular motors at maximum power
• Dynamic scaling in natural swarms
• Faster uphill relaxation in thermodynamically equidistant temperature quenches
• Entropic bounds on currents in Langevin systems
• Sub $k_{B}T$ micro-electromechanical irreversible logic gate
• Information and thermodynamics: fast and precise approach to Landauer's bound in an underdamped micro-mechanical oscillator
• A geometric approach to optimal nonequilibrium control: Minimizing dissipation in nanomagnetic spin systems
• Driving rapidly while remaining in control: classical shortcuts from Hamiltonian to stochastic dynamics
• Universal Bound on Energy Cost of Bit Reset in Finite Time
• Optimal finite-time bit erasure under full control
• Underdamped stochastic heat engine at maximum efficiency
• Heating and Cooling are Fundamentally Asymmetric and Evolve Along Distinct Pathways
• Active matter under control: Insights from response theory
• Optimal transport and control of active drops
• Dynamics of information erasure and extension of Landauer's bound to fast processes
• Quantum thermodynamics of systems with anomalous dissipative coupling
• Quasi-periodic motions in dynamical systems. Review of a renormalisation group approach
• A unified, geometric framework for nonequilibrium protocol optimization
• On how nanomechanical systems can minimize dissipation
• E. Schrödinger's 1931 paper "On the Reversal of the Laws of Nature" ["Über die Umkehrung der Naturgesetze",Sitzungsberichte der preussischen Akademie der Wissenschaften, physikalische mathematische Klasse, 8 N9 144-153]
• Thermodynamics at the microscale: from effective heating to the Brownian Carnot engine
• Optimality of non-conservative driving for finite-time processes with discrete states
• Heat release by controlled continuous-time Markov jump processes
• Control of Active Brownian Particles: An exact solution
• Taming the time evolution in overdamped systems: shortcuts elaborated from fast-forward and time-reversed protocols
• On extremals of the entropy production by "Langevin-Kramers" dynamics
• On the efficiency of heat engines at the micro-scale and below
• Shortcuts to equilibrium with a levitated particle in the underdamped regime
• On the use of stochastic differential geometry for non-equilibrium thermodynamics modeling and control
• Non-Markovian Momentum Computing: Universal and Efficient
• Designing the Optimal Bit: Balancing Energetic Cost, Speed and Reliability
• Effects of a dissipative coupling to the momentum of a particle in a double well potential
• Shortcuts To Adiabaticity for Lévy processes in harmonic traps
• Classical uncertainty relations and entropy production in non-equilibrium statistical mechanics
• Around the entropic Talagrand inequality

Cited by in corpus (6)

• Learning efficient erasure protocols for an underdamped memory
• Minimal work protocols for inertial particles in non-harmonic traps
• Optimal control of levitated nanoparticles through finite-stiffness confinement
• On the numerical integration of the Fokker-Planck equation driven by a mechanical force and the Bismut-Elworthy-Li formula
• Decomposition of metric tensor in thermodynamic geometry in terms of relaxation timescales
• Lower Bound of Entropy Production in an Underdamped Langevin System with Normal Distributions