Adaptive sampling of large deviations
arXiv:1803.11117 · doi:10.1007/s10955-018-2108-8
Abstract
We introduce and test an algorithm that adaptively estimates large deviation functions characterizing the fluctuations of additive functionals of Markov processes in the long-time limit. These functions play an important role for predicting the probability and pathways of rare events in stochastic processes, as well as for understanding the physics of nonequilibrium systems driven in steady states by external forces and reservoirs. The algorithm uses methods from risk-sensitive and feedback control to estimate from a single trajectory a new process, called the driven process, known to be efficient for importance sampling. Its advantages compared to other simulation techniques, such as splitting or cloning, are discussed and illustrated with simple equilibrium and nonequilibrium diffusion models.
arXiv commentv1: 20 pages, 5 figures; v2: minor typos corrected; v3 typos in Eq. (51) corrected
References in corpus (31)
- Brownian motors: noisy transport far from equilibrium
- The large deviation approach to statistical mechanics
- Non equilibrium steady states: fluctuations and large deviations of the density and of the current
- General state space Markov chains and MCMC algorithms
- Dynamic first-order phase transition in kinetically constrained models of glasses
- Fluctuation theorems for stochastic dynamics
- Direct evaluation of large-deviation functions
- Nonequilibrium Markov processes conditioned on large deviations
- Large deviations and ensembles of trajectories in stochastic models
- Nonequilibrium microcanonical and canonical ensembles and their equivalence
- A numerical approach to large deviations in continuous-time
- Variational and optimal control representations of conditioned and driven processes
- Fluctuations in out of equilibrium systems: from theory to experiment
- Population dynamics method with a multi-canonical feedback control
- The instanton method and its numerical implementation in fluid mechanics
- Current large deviations for driven periodic diffusions
- Adaptive importance sampling for control and inference
- Dynamical phase transition for current statistics in a simple driven diffusive system
- Go with the Winners: a General Monte Carlo Strategy
- Finite-Size Scaling of a First-Order Dynamical Phase Transition: Adaptive Population Dynamics and an Effective Model
- Large deviation function for entropy production in driven one-dimensional systems
- Dynamic importance sampling for uniformly recurrent markov chains
- Efficient Rare Event Simulation by Optimal Nonequilibrium Forcing
- Computation of Large Deviation Statistics via Iterative Measurement-and-Feedback Procedure
- Convergence of large deviation estimators
- Variational formula for experimental determination of high-order correlations of current fluctuations in driven systems
- Finite-time and finite-size scalings in the evaluation of large-deviation functions: Analytical study using a birth-death process
- Fast randomized iteration: diffusion Monte Carlo through the lens of numerical linear algebra
- Finite size scaling of current fluctuations in the totally asymmetric exclusion process
- Stochastic Optimal Control as Non-equilibrium Statistical Mechanics: Calculus of Variations over Density and Current
- Singularities in Large Deviation Functionals of Bulk-Driven Transport Models
Cited by in corpus (40)
- Ergodicity and large deviations in physical systems with stochastic dynamics
- Numerical computation of rare events via large deviation theory
- Using matrix product states to study the dynamical large deviations of kinetically constrained models
- How dissipation constrains fluctuations in nonequilibrium liquids: Diffusion, structure and biased interactions
- Effective driven dynamics for one-dimensional conditioned Langevin processes in the weak-noise limit
- A reinforcement learning approach to rare trajectory sampling
- Classical Nucleation Theory for Active Fluid Phase Separation
- Physically consistent numerical solver for time-dependent Fokker-Planck equations
- Sampling rare events across dynamical phase transitions
- Variational control forces for enhanced sampling of nonequilibrium molecular dynamics simulations
- Learning nonequilibrium control forces to characterize dynamical phase transitions
- Reinforcement learning of rare diffusive dynamics
- Dynamical large deviations of linear diffusions
- Large deviations of random walks on random graphs
- Finite time large deviations via matrix product states
- Periodically driven jump processes conditioned on large deviations
- Optimal sampling of dynamical large deviations via matrix product states
- Variational design principles for nonequilibrium colloidal assembly
- Evolutionary reinforcement learning of dynamical large deviations
- Direct evaluation of dynamical large-deviation rate functions using a variational ansatz
- Optimal sampling of dynamical large deviations in two dimensions via tensor networks
- Large deviations and optimal control forces for hard particles in one dimension
- Effective Hamiltonians and Lagrangians for conditioned Markov processes at large volume
- The probabilistic superiority of stochastic symplectic methods via large deviations principles
- Generalized optimal paths and weight distributions revealed through the large deviations of random walks on networks
- Large deviations in models of growing clusters with symmetry-breaking transitions
- A Deep Learning Functional Estimator of Optimal Dynamics for Sampling Large Deviations
- Large deviations principles for symplectic discretizations of stochastic linear Schrödinger Equation
- Non equivalence of dynamical ensembles and emergent non ergodicity
- Modeling of biomolecular machines in non-equilibrium steady states
- On a new class of score functions to estimate tail probabilities of some stochastic processes with Adaptive Multilevel Splitting
- A Hybrid Monte Carlo algorithm for sampling rare events in space-time histories of stochastic fields
- Rare event simulation for stochastic dynamics in continuous time
- Adaptive power method for estimating large deviations in Markov chains
- Physics-informed graph neural networks enhance scalability of variational nonequilibrium optimal control
- Variational time reversal for free energy estimation in nonequilibrium steady states
- Stochastic gradient descent and fast relaxation to thermodynamic equilibrium: a stochastic control approach
- Maximal dispersion of adaptive random walks
- Understanding random-walk dynamical phase coexistence through waiting times
- Making rare events typical in -dimensional chaotic maps