Numerical computation of rare events via large deviation theory

Abstract

An overview of rare events algorithms based on large deviation theory (LDT) is presented. It covers a range of numerical schemes to compute the large deviation minimizer in various setups, and discusses best practices, common pitfalls, and implementation trade-offs. Generalizations, extensions, and improvements of the minimum action methods are proposed. These algorithms are tested on example problems which illustrate several common difficulties which arise e.g. when the forcing is degenerate or multiplicative, or the systems are infinite-dimensional. Generalizations to processes driven by non-Gaussian noises or random initial data and parameters are also discussed, along with the connection between the LDT-based approach reviewed here and other methods, such as stochastic field theory and optimal control. Finally, the integration of this approach in importance sampling methods using e.g. genealogical algorithms is explored.

References in corpus (19)

• String Method for the Study of Rare Events
• A theory of regularity structures
• Nonequilibrium Markov processes conditioned on large deviations
• Simulating rare events in dynamical processes
• The instanton method and its numerical implementation in fluid mechanics
• Current large deviations for driven periodic diffusions
• Optimal Path to Epigenetic Switching
• Large negative velocity gradients in Burgers turbulence
• Large deviations for white-noise driven, nonlinear stochastic PDEs in two and three dimensions
• Adaptive sampling of large deviations
• Efficient Rare Event Simulation by Optimal Nonequilibrium Forcing
• Large deviation function for the entropy production: Optimal trajectory and role of fluctuations
• Instanton filtering for the stochastic Burgers equation
• Statistics of large currents in the Kipnis-Marchioro-Presutti model in a ring geometry
• Rare event computation in deterministic chaotic systems using genealogical particle analysis
• Arclength parametrized Hamilton's equations for the calculation of instantons
• Relevance of instantons in Burgers turbulence
• Efficient Computation of Instantons for Multi-Dimensional Turbulent Flows with Large Scale Forcing
• String Method for Generalized Gradient Flows: Computation of Rare Events in Reversible Stochastic Processes

Cited by in corpus (45)

• The Seven Deadly Sins: when computing crystal nucleation rates, the devil is in the details
• Fingerprinting Heatwaves and Cold Spells and Assessing Their Response to Climate Change using Large Deviation Theory
• Classical Nucleation Theory for Active Fluid Phase Separation
• Dynamical Landscape and Multistability of a Climate Model
• Applications of large deviation theory in geophysical fluid dynamics and climate science
• Sticky Brownian Motion and its Numerical Solution
• Extreme events in transitional turbulence
• A Machine Learning Framework for Computing the Most Probable Paths of Stochastic Dynamical Systems
• Periodically driven jump processes conditioned on large deviations
• Multistability and rare spontaneous transitions in barotropic $\beta$-plane turbulence
• Lévy-noise versus Gaussian-noise-induced Transitions in the Ghil-Sellers Energy Balance Model
• Transition path theory for Langevin dynamics on manifold: optimal control and data-driven solver
• Spontaneous Symmetry Breaking for Extreme Vorticity and Strain in the 3D Navier-Stokes Equations
• Coupling rare event algorithms with data-based learned committor functions using the analogue Markov chain
• Instantons for the destabilization of the inner Solar System
• Symmetries and zero modes in sample path large deviations
• Gel'fand-Yaglom type equations for calculating fluctuations around Instantons in stochastic systems
• Collapse of transitional wall turbulence captured using a rare events algorithm
• Path integral derivation and numerical computation of large deviation prefactors for non-equilibrium dynamics through matrix Riccati equations
• Instantons for rare events in heavy-tailed distributions
• Experimental measurement of relative path probabilities and stochastic actions
• Saddle avoidance of noise-induced transitions in multiscale systems
• A Monte Carlo algorithm to measure probabilities of rare events in cluster-cluster aggregation
• Confined run and tumble particles with non-Markovian tumbling statistics
• Precursors to Rare Events in Stochastic Resonance
• Large Deviation Analysis of Function Sensitivity in Random Deep Neural Networks
• Scalable Methods for Computing Sharp Extreme Event Probabilities in Infinite-Dimensional Stochastic Systems
• Melancholia States of the Atlantic Meridional Overturning Circulation
• Eddy-Viscous Modeling and the Topology of Extreme Circulation Events in Three-Dimensional Turbulence
• Transient probability currents provide upper and lower bounds on non-equilibrium steady-state currents in the Smoluchowski picture
• A Dynamical Systems Approach for Most Probable Escape Paths over Periodic Boundaries
• Extreme events and instantons in Lagrangian passive scalar turbulence models
• Anomalous Statistics and Large Deviations of Turbulent Water Waves past a Step
• A unified perspective on exponential tilt and bridge algorithms for rare trajectories of discrete Markov processes
• Accelerated first-passage dynamics in a non-Markovian feedback Ornstein--Uhlenbeck process
• Does rare, noise-induced, bypass transition in plane Couette flow bypass instantons ?
• Large deviations for trajectory observables of diffusion processes in dimension $d>1$ in the double limit of large time and small diffusion coefficient
• Noise equals control
• Constructing Extreme Heatwave Storylines with Differentiable Climate Models
• Optimal finite-differences discretization for the diffusion equation from the perspective of large-deviation theory
• Synthetic Turbulence via an Instanton Gas Approximation
• Rare Trajectories in a Prototypical Mean-field Disordered Model: Insights into Landscape and Instantons
• Understanding the stochastic dynamics of sequential decision-making processes: A path-integral analysis of multi-armed bandits
• Density-dependent stochastic resetting: a large deviations framework for achieving target distributions over networks
• Sampling rare trajectories using stochastic bridges