Variational and optimal control representations of conditioned and driven processes

Abstract

We have shown recently that a Markov process conditioned on rare events involving time-integrated random variables can be described in the long-time limit by an effective Markov process, called the driven process, which is given mathematically by a generalization of Doob's $h$-transform. We show here that this driven process can be represented in two other ways: first, as a process satisfying various variational principles involving large deviation functions and relative entropies and, second, as an optimal stochastic control process minimizing a cost function also related to large deviation functions. These interpretations of the driven process generalize and unify many previous results on maximum entropy approaches to nonequilibrium systems, spectral characterizations of positive operators, and control approaches to large deviation theory. They also lead, as briefly discussed, to new methods for analytically or numerically approximating large deviation functions.

v1: 38 pages, 2 figures; v2: some typos corrected; v3: minor typos corrected. Print this version - the published one is ugly!

References in corpus (10)

• The large deviation approach to statistical mechanics
• Non equilibrium steady states: fluctuations and large deviations of the density and of the current
• First-order dynamical phase transition in models of glasses: an approach based on ensembles of histories
• A numerical approach to large deviations in continuous-time
• Steady state statistics of driven diffusions
• Equivalence and nonequivalence of ensembles: Thermodynamic, macrostate, and measure levels
• Effective interactions and large deviations in stochastic processes
• Construction of a Coordinate Bethe Ansatz for the asymmetric simple exclusion process with open boundaries
• Non-equilibrium steady states : maximization of the Shannon entropy associated to the distribution of dynamical trajectories in the presence of constraints
• Simulation of large deviation functions using population dynamics

Cited by in corpus (119)

• Current fluctuations and transport efficiency for general Langevin systems
• Introduction to dynamical large deviations of Markov processes
• Unravelling the large deviation statistics of Markovian open quantum systems
• Ergodicity and large deviations in physical systems with stochastic dynamics
• Population dynamics method with a multi-canonical feedback control
• Current large deviations for driven periodic diffusions
• Optimizing active work: Dynamical phase transitions, collective motion, and jamming
• Making rare events typical in Markovian open quantum systems
• A minimal model of dynamical phase transition
• A geometric approach to optimal nonequilibrium control: Minimizing dissipation in nanomagnetic spin systems
• Large deviations and dynamical phase transitions in stochastic chemical networks
• Dynamical phase transition in drifted Brownian motion
• Near-optimal protocols in complex nonequilibrium transformations
• Anomalous scaling of dynamical large deviations
• Large deviations conditioned on large deviations I: Markov chain and Langevin equation
• Entropy production fluctuations encode collective behavior in active matter
• Rare behavior of growth processes via umbrella sampling of trajectories
• Exact large deviation statistics and trajectory phase transition of a deterministic boundary driven cellular automaton
• Diffusions conditioned on occupation measures
• A reinforcement learning approach to rare trajectory sampling
• Adaptive sampling of large deviations
• Large deviations conditioned on large deviations II: Fluctuating hydrodynamics
• Large-deviation theory for a Brownian particle on a ring: a WKB approach
• Large deviations at level 2.5 for Markovian open quantum systems: quantum jumps and quantum state diffusion
• Building continuous time crystals from rare events
• Collective motion in large deviations of active particles
• Dynamical large deviations of reflected diffusions
• Order and symmetry-breaking in the fluctuations of driven systems
• Canonical structure and orthogonality of forces and currents in irreversible Markov chains
• Variational control forces for enhanced sampling of nonequilibrium molecular dynamics simulations
• Sampling rare events across dynamical phase transitions
• Learning nonequilibrium control forces to characterize dynamical phase transitions
• Reinforcement learning of rare diffusive dynamics
• Large deviations for Markov processes with stochastic resetting : analysis via the empirical density and flows or via excursions between resets
• Dynamical large deviations of linear diffusions
• Process interpretation of current entropic bounds
• Large deviations of the Lyapunov exponent in 2D matrix Langevin dynamics with applications to one-dimensional Anderson Localization models
• Large deviations of random walks on random graphs
• E. Schrödinger's 1931 paper "On the Reversal of the Laws of Nature" ["Über die Umkehrung der Naturgesetze",Sitzungsberichte der preussischen Akademie der Wissenschaften, physikalische mathematische Klasse, 8 N9 144-153]
• Periodically driven jump processes conditioned on large deviations
• Giant leaps and long excursions: fluctuation mechanisms in systems with long-range memory
• Direct evaluation of rare events in active matter from variational path sampling
• Nonequilibrium diffusion processes via non-Hermitian electromagnetic quantum mechanics with application to the statistics of entropy production in the Brownian gyrator
• Evolutionary reinforcement learning of dynamical large deviations
• Role of current fluctuations in nonreversible samplers
• Direct evaluation of dynamical large-deviation rate functions using a variational ansatz
• Variational design principles for nonequilibrium colloidal assembly
• Revisiting the Ruelle thermodynamic formalism for Markov trajectories with application to the glassy phase of random trap models
• Large deviations at various levels for run-and-tumble processes with space-dependent velocities and space-dependent switching rates
• Large deviations and optimal control forces for hard particles in one dimension
• Shortcuts in stochastic systems and control of biophysical processes
• Effective Hamiltonians and Lagrangians for conditioned Markov processes at large volume
• Landau theory for finite-time dynamical phase transitions
• Thermodynamics of quantum trajectories on a quantum computer
• Large deviations for the Skew-Detailed-Balance Lifted-Markov processes to sample the equilibrium distribution of the Curie-Weiss model
• Catching and reversing quantum jumps and thermodynamics of quantum trajectories
• Large deviations in models of growing clusters with symmetry-breaking transitions
• Nonequilibrium thermodynamic potentials for continuous-time Markov chains
• Jump-Drift and Jump-Diffusion Processes : Large Deviations for the density, the current and the jump-flow and for the excursions between jumps
• A large deviation theory perspective on nanoscale transport phenomena
• Noise correction of large deviations with anomalous scaling
• Large deviations for metastable states of Markov processes with absorbing states with applications to population models in stable or randomly switching environment
• Conditioned diffusion processes with an absorbing boundary condition for finite or infinite horizon
• Tricritical behavior in dynamical phase transitions
• Efficiency of one-dimensional active transport conditioned on motility
• Graph-combinatorial approach for large deviations of Markov chains
• Variational deep learning of equilibrium transition path ensembles
• Dynamical criticality in open systems: non-perturbative physics, microscopic origin and direct observation
• Stochastic gene expression conditioned on large deviations
• An Optimal Control Derivation of Nonlinear Smoothing Equations
• Occupation time statistics of a gas of interacting diffusing particles
• Constructing Auxiliary Dynamics for Nonequilibrium Stationary States by Variance Minimization
• Modeling of biomolecular machines in non-equilibrium steady states
• Varied phenomenology of models displaying dynamical large-deviation singularities
• Large deviations of the stochastic area for linear diffusions
• Sampling rare fluctuations of discrete-time Markov chains
• Entropy Regularized Reinforcement Learning Using Large Deviation Theory
• Large deviations for the Pearson family of ergodic diffusion processes involving a quadratic diffusion coefficient and a linear force
• Conditioning diffusion processes with killing rates
• Microcanonical conditioning of Markov processes on time-additive observables
• Microscopic biasing of discrete-time quantum trajectories
• Dynamical phase coexistence in the Fredrickson-Andersen model
• Spectral signatures of symmetry-breaking dynamical phase transitions
• Revisiting boundary-driven non-equilibrium Markov dynamics in arbitrary potentials via supersymmetric quantum mechanics and explicit large deviations at various levels
• Efficient large deviation estimation based on importance sampling
• Delocalization-localization dynamical phase transition of random walks on graphs
• An introduction to large deviations with applications in physics
• Large deviations and conditioning for chaotic non-invertible deterministic maps: analysis via the forward deterministic dynamics and the backward stochastic dynamics
• Adaptive power method for estimating large deviations in Markov chains
• Inhomogeneous asymmetric exclusion processes between two reservoirs : large deviations for the local empirical observables in the Mean-Field approximation
• Physics-informed graph neural networks enhance scalability of variational nonequilibrium optimal control
• Conditioning diffusion processes with respect to the local time at the origin
• Bringing together two paradigms of non-equilibrium: Fragile versus robust aging in driven glassy systems
• Dynamical phase transitions for the activity biased Ising model in a magnetic field
• Asymptotic equivalence of probability measures and stochastic processes
• Symmetries and Geometrical Properties of Dynamical Fluctuations in Molecular Dynamics
• Maximal dispersion of adaptive random walks
• Space-time correlations in monitored kinetically constrained discrete-time quantum dynamics
• Reaction-Path Statistical Mechanics of Enzymatic Kinetics
• Explicit dynamical properties of the Pelikan random map in the chaotic region and at the intermittent critical point towards the non-chaotic region
• On the Kemeny time for continuous-time reversible and irreversible Markov processes with applications to stochastic resetting and to conditioning towards forever-survival
• Joint distribution of two Local Times for diffusion processes with the application to the construction of various conditioned processes
• Large deviations at level 2.5 and for trajectories observables of diffusion processes : the missing parts with respect to their random-walks counterparts
• Multi-point nonequilibrium umbrella sampling and associated fluctuation relations
• Dynamical equivalence classes for Markov jump processes
• Large deviations for trajectory observables of diffusion processes in dimension $d>1$ in the double limit of large time and small diffusion coefficient
• A supersymmetric quantum perspective on the explicit large deviations for reversible Markov jump processes, with applications to pure and random spin chains
• Noise equals control
• Critical behavior of a programmable time-crystal lattice gas
• Understanding random-walk dynamical phase coexistence through waiting times
• Non-empirical weighted Langevin mechanics for the potential escape problem: parallel algorithm and application to the Argon clusters
• Inverse problem in the conditioning of Markov processes on trajectory observables : what canonical conditionings can connect two given Markov generators ?
• Towards neural reinforcement learning for large deviations in nonequilibrium systems with memory
• Density-dependent stochastic resetting: a large deviations framework for achieving target distributions over networks
• Conditioning two diffusion processes with respect to their first-encounter properties
• Fluctuation Relations associated to an arbitrary bijection in path space
• Deterministic particle flows for constraining stochastic nonlinear systems
• Making rare events typical in $d$-dimensional chaotic maps
• Non-equilibrium pathways between cluster morphologies in active phase separation: necking, rupture and cavitation