Improving control based importance sampling strategies for metastable diffusions via adapted metadynamics
arXiv:2206.06628 · doi:10.1137/22M1503464
Abstract
Sampling rare events in metastable dynamical systems is often a computationally expensive task and one needs to resort to enhanced sampling methods such as importance sampling. Since we can formulate the problem of finding optimal importance sampling controls as a stochastic optimization problem, this then brings additional numerical challenges and the convergence of corresponding algorithms might as well suffer from metastabilty. In this article, we address this issue by combining systematic control approaches with the heuristic adaptive metadynamics method. Crucially, we approximate the importance sampling control by a neural network, which makes the algorithm in principle feasible for high-dimensional applications. We can numerically demonstrate in relevant metastable problems that our algorithm is more effective than previous attempts and that only the combination of the two approaches leads to a satisfying convergence and therefore to an efficient sampling in certain metastable settings.
References in corpus (10)
- Escaping free-energy minima
- Determining the density of states for classical statistical models: A random walk algorithm to produce a flat histogram
- Deep learning-based numerical methods for high-dimensional parabolic partial differential equations and backward stochastic differential equations
- Equilibrium free energies from non-equilibrium metadynamics
- Importance Sampling for Multiscale Diffusions
- Actor-Critic Method for High Dimensional Static Hamilton--Jacobi--Bellman Partial Differential Equations based on Neural Networks
- Efficient Rare Event Simulation by Optimal Nonequilibrium Forcing
- Importance sampling in path space for diffusion processes with slow-fast variables
- Escaping from an attractor: Importance sampling and rest points I
- Variational approach to rare event simulation using least-squares regression