Coupling rare event algorithms with data-based learned committor functions using the analogue Markov chain

Abstract

Rare events play a crucial role in many physics, chemistry, and biology phenomena, when they change the structure of the system, for instance in the case of multistability, or when they have a huge impact. Rare event algorithms have been devised to simulate them efficiently, avoiding the computation of long periods of typical fluctuations. We consider here the family of splitting or cloning algorithms, which are versatile and specifically suited for far-from-equilibrium dynamics. To be efficient, these algorithms need to use a smart score function during the selection stage. Committor functions are the optimal score functions. In this work we propose a new approach, based on the analogue Markov chain, for a data-based learning of approximate committor functions. We demonstrate that such learned committor functions are extremely efficient score functions when used with the Adaptive Multilevel Splitting algorithm. We illustrate our approach for a gradient dynamics in a three-well potential, and for the Charney-DeVore model, which is a paradigmatic toy model of multistability for atmospheric dynamics. For these two dynamics, we show that having observed a few transitions is enough to have a very efficient data-based score function for the rare event algorithm. This new approach is promising for use for complex dynamics: the rare events can be simulated with a minimal prior knowledge and the results are much more precise than those obtained with a user-designed score function.

References in corpus (42)

• An efficient, multiple range random walk algorithm to calculate the density of states
• A Data-Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition
• VAMPnets: Deep learning of molecular kinetics
• Computation of extreme heat waves in climate models using a large deviation algorithm
• Probing rare physical trajectories with Lyapunov weighted dynamics
• Rogue Waves and Large Deviations in Deep Sea
• Population dynamics method with a multi-canonical feedback control
• Numerical computation of rare events via large deviation theory
• Galerkin Approximation of Dynamical Quantities using Trajectory Data
• A rare event algorithm links transitions in turbulent flows with activated nucleations
• Special Topic: Markov Models of Molecular Kinetics
• Computing Committor Functions for the Study of Rare Events Using Deep Learning
• An early warning indicator for atmospheric blocking events using transfer operators
• Transition manifolds of complex metastable systems: Theory and data-driven computation of effective dynamics
• Practical rare event sampling for extreme mesoscale weather
• Computing transition rates for the 1-D stochastic Ginzburg--Landau--Allen--Cahn equation for finite-amplitude noise with a rare event algorithm
• Instanton filtering for the stochastic Burgers equation
• Computing return times or return periods with rare event algorithms
• Rare event computation in deterministic chaotic systems using genealogical particle analysis
• Sampling rare events across dynamical phase transitions
• Computation of rare transitions in the barotropic quasi-geostrophic equations
• Transition paths of marine debris and the stability of the garbage patches
• Learning forecasts of rare stratospheric transitions from short simulations
• Long Term Effects of Small Random Perturbations on Dynamical Systems: Theoretical and Computational Tools
• Statistical behavior of adaptive multilevel splitting algorithms in simple models
• Using local dynamics to explain analog forecasting of chaotic systems
• Multistability and rare spontaneous transitions in barotropic $\beta$-plane turbulence
• Committor Functions for Climate Phenomena at the Predictability Margin: The example of El Niño Southern Oscillation in the Jin and Timmerman model
• Rare Event Sampling Improves Mercury Instability Statistics
• Computation of extremes values of time averaged observables in climate models with large deviation techniques
• Instanton based importance sampling for rare events in stochastic PDEs
• The Role of Data in Model Building and Prediction: A Survey Through Examples
• Maximizing simulated tropical cyclone intensity with action minimization
• Instantons for the destabilization of the inner Solar System
• Numerical study of extreme mechanical force exerted by a turbulent flow on a bluff body by direct and rare-event sampling techniques
• Harmonic Measure for Percolation and Ising Clusters Including Rare Events
• Collapse of transitional wall turbulence captured using a rare events algorithm
• Path properties of atmospheric transitions: illustration with a low-order sudden stratospheric warming model
• Efficient Computation of Instantons for Multi-Dimensional Turbulent Flows with Large Scale Forcing
• On a new class of score functions to estimate tail probabilities of some stochastic processes with Adaptive Multilevel Splitting
• Method to measure efficiently rare fluctuations of turbulence intensity for turbulent-laminar transitions in pipe flows
• Large deviations principle for the Adaptive Multilevel Splitting Algorithm in an idealized setting

Cited by in corpus (6)

• Committor Functions for Climate Phenomena at the Predictability Margin: The example of El Niño Southern Oscillation in the Jin and Timmerman model
• Inexact iterative numerical linear algebra for neural network-based spectral estimation and rare-event prediction
• Data-driven methods to estimate the committor function in conceptual ocean models
• Data-driven transition path analysis yields a statistical understanding of sudden stratospheric warming events in an idealized model
• Does rare, noise-induced, bypass transition in plane Couette flow bypass instantons ?
• Boosting Ensembles for Statistics of Tails at Conditionally Optimal Advance Split Times