Adaptive sampling of large deviations

Abstract

We introduce and test an algorithm that adaptively estimates large deviation functions characterizing the fluctuations of additive functionals of Markov processes in the long-time limit. These functions play an important role for predicting the probability and pathways of rare events in stochastic processes, as well as for understanding the physics of nonequilibrium systems driven in steady states by external forces and reservoirs. The algorithm uses methods from risk-sensitive and feedback control to estimate from a single trajectory a new process, called the driven process, known to be efficient for importance sampling. Its advantages compared to other simulation techniques, such as splitting or cloning, are discussed and illustrated with simple equilibrium and nonequilibrium diffusion models.

v1: 20 pages, 5 figures; v2: minor typos corrected; v3 typos in Eq. (51) corrected

References in corpus (8)

• The large deviation approach to statistical mechanics
• Non equilibrium steady states: fluctuations and large deviations of the density and of the current
• Dynamic first-order phase transition in kinetically constrained models of glasses
• Fluctuation theorems for stochastic dynamics
• A numerical approach to large deviations in continuous-time
• Finite-Size Scaling of a First-Order Dynamical Phase Transition: Adaptive Population Dynamics and an Effective Model
• Large deviation function for entropy production in driven one-dimensional systems
• Dynamic importance sampling for uniformly recurrent markov chains

Cited by in corpus (40)

• Ergodicity and large deviations in physical systems with stochastic dynamics
• Numerical computation of rare events via large deviation theory
• Using matrix product states to study the dynamical large deviations of kinetically constrained models
• How dissipation constrains fluctuations in nonequilibrium liquids: Diffusion, structure and biased interactions
• Effective driven dynamics for one-dimensional conditioned Langevin processes in the weak-noise limit
• A reinforcement learning approach to rare trajectory sampling
• Classical Nucleation Theory for Active Fluid Phase Separation
• Physically consistent numerical solver for time-dependent Fokker-Planck equations
• Sampling rare events across dynamical phase transitions
• Variational control forces for enhanced sampling of nonequilibrium molecular dynamics simulations
• Learning nonequilibrium control forces to characterize dynamical phase transitions
• Reinforcement learning of rare diffusive dynamics
• Dynamical large deviations of linear diffusions
• Large deviations of random walks on random graphs
• Finite time large deviations via matrix product states
• Periodically driven jump processes conditioned on large deviations
• Optimal sampling of dynamical large deviations via matrix product states
• Variational design principles for nonequilibrium colloidal assembly
• Evolutionary reinforcement learning of dynamical large deviations
• Direct evaluation of dynamical large-deviation rate functions using a variational ansatz
• Optimal sampling of dynamical large deviations in two dimensions via tensor networks
• Large deviations and optimal control forces for hard particles in one dimension
• Effective Hamiltonians and Lagrangians for conditioned Markov processes at large volume
• The probabilistic superiority of stochastic symplectic methods via large deviations principles
• Generalized optimal paths and weight distributions revealed through the large deviations of random walks on networks
• Large deviations in models of growing clusters with symmetry-breaking transitions
• A Deep Learning Functional Estimator of Optimal Dynamics for Sampling Large Deviations
• Large deviations principles for symplectic discretizations of stochastic linear Schrödinger Equation
• Non equivalence of dynamical ensembles and emergent non ergodicity
• Modeling of biomolecular machines in non-equilibrium steady states
• On a new class of score functions to estimate tail probabilities of some stochastic processes with Adaptive Multilevel Splitting
• A Hybrid Monte Carlo algorithm for sampling rare events in space-time histories of stochastic fields
• Rare event simulation for stochastic dynamics in continuous time
• Adaptive power method for estimating large deviations in Markov chains
• Physics-informed graph neural networks enhance scalability of variational nonequilibrium optimal control
• Variational time reversal for free energy estimation in nonequilibrium steady states
• Stochastic gradient descent and fast relaxation to thermodynamic equilibrium: a stochastic control approach
• Maximal dispersion of adaptive random walks
• Understanding random-walk dynamical phase coexistence through waiting times
• Making rare events typical in $d$-dimensional chaotic maps