Numerical computation of rare events via large deviation theory

Abstract

An overview of rare events algorithms based on large deviation theory (LDT) is presented. It covers a range of numerical schemes to compute the large deviation minimizer in various setups, and discusses best practices, common pitfalls, and implementation trade-offs. Generalizations, extensions, and improvements of the minimum action methods are proposed. These algorithms are tested on example problems which illustrate several common difficulties which arise e.g. when the forcing is degenerate or multiplicative, or the systems are infinite-dimensional. Generalizations to processes driven by non-Gaussian noises or random initial data and parameters are also discussed, along with the connection between the LDT-based approach reviewed here and other methods, such as stochastic field theory and optimal control. Finally, the integration of this approach in importance sampling methods using e.g. genealogical algorithms is explored.

References in corpus (2)

• Large deviation function for the entropy production: Optimal trajectory and role of fluctuations
• Relevance of instantons in Burgers turbulence

Cited by in corpus (44)

• The Seven Deadly Sins: when computing crystal nucleation rates, the devil is in the details
• Fingerprinting Heatwaves and Cold Spells and Assessing Their Response to Climate Change using Large Deviation Theory
• Classical Nucleation Theory for Active Fluid Phase Separation
• Dynamical Landscape and Multistability of a Climate Model
• Applications of large deviation theory in geophysical fluid dynamics and climate science
• Sticky Brownian Motion and its Numerical Solution
• Extreme events in transitional turbulence
• A Machine Learning Framework for Computing the Most Probable Paths of Stochastic Dynamical Systems
• Periodically driven jump processes conditioned on large deviations
• Multistability and rare spontaneous transitions in barotropic $\beta$-plane turbulence
• Lévy-noise versus Gaussian-noise-induced Transitions in the Ghil-Sellers Energy Balance Model
• Transition path theory for Langevin dynamics on manifold: optimal control and data-driven solver
• Spontaneous Symmetry Breaking for Extreme Vorticity and Strain in the 3D Navier-Stokes Equations
• Coupling rare event algorithms with data-based learned committor functions using the analogue Markov chain
• Instantons for the destabilization of the inner Solar System
• Symmetries and zero modes in sample path large deviations
• Gel'fand-Yaglom type equations for calculating fluctuations around Instantons in stochastic systems
• Collapse of transitional wall turbulence captured using a rare events algorithm
• Path integral derivation and numerical computation of large deviation prefactors for non-equilibrium dynamics through matrix Riccati equations
• Instantons for rare events in heavy-tailed distributions
• Experimental measurement of relative path probabilities and stochastic actions
• Saddle avoidance of noise-induced transitions in multiscale systems
• A Monte Carlo algorithm to measure probabilities of rare events in cluster-cluster aggregation
• Confined run and tumble particles with non-Markovian tumbling statistics
• Precursors to Rare Events in Stochastic Resonance
• Large Deviation Analysis of Function Sensitivity in Random Deep Neural Networks
• Scalable Methods for Computing Sharp Extreme Event Probabilities in Infinite-Dimensional Stochastic Systems
• Melancholia States of the Atlantic Meridional Overturning Circulation
• Eddy-Viscous Modeling and the Topology of Extreme Circulation Events in Three-Dimensional Turbulence
• A Dynamical Systems Approach for Most Probable Escape Paths over Periodic Boundaries
• Extreme events and instantons in Lagrangian passive scalar turbulence models
• Anomalous Statistics and Large Deviations of Turbulent Water Waves past a Step
• A unified perspective on exponential tilt and bridge algorithms for rare trajectories of discrete Markov processes
• Accelerated first-passage dynamics in a non-Markovian feedback Ornstein--Uhlenbeck process
• Does rare, noise-induced, bypass transition in plane Couette flow bypass instantons ?
• Optimal finite-differences discretization for the diffusion equation from the perspective of large-deviation theory
• Large deviations for trajectory observables of diffusion processes in dimension $d>1$ in the double limit of large time and small diffusion coefficient
• Noise equals control
• Constructing Extreme Heatwave Storylines with Differentiable Climate Models
• Synthetic Turbulence via an Instanton Gas Approximation
• Rare Trajectories in a Prototypical Mean-field Disordered Model: Insights into Landscape and Instantons
• Sampling rare trajectories using stochastic bridges
• Understanding the stochastic dynamics of sequential decision-making processes: A path-integral analysis of multi-armed bandits
• Density-dependent stochastic resetting: a large deviations framework for achieving target distributions over networks