Dynamical computation of the density of states and Bayes factors using nonequilibrium importance sampling
arXiv:1809.11132 · doi:10.1103/PhysRevLett.122.150602
Abstract
Nonequilibrium sampling is potentially much more versatile than its equilibrium counterpart, but it comes with challenges because the invariant distribution is not typically known when the dynamics breaks detailed balance. Here, we derive a generic importance sampling technique that leverages the statistical power of configurations transported by nonequilibrium trajectories, and can be used to compute averages with respect to arbitrary target distributions. As a dissipative reweighting scheme, the method can be viewed in relation to the annealed importance sampling (AIS) method and the related Jarzynski equality. Unlike AIS, our approach gives an unbiased estimator, with provably lower variance than directly estimating the average of an observable. We also establish a direct relation between a dynamical quantity, the dissipation, and the volume of phase space, from which we can compute quantities such as the density of states and Bayes factors. We illustrate the properties of estimators relying on this sampling technique in the context of density of state calculations, showing that it scales favorable with dimensionality -- in particular, we show that it can be used to compute the phase diagram of the mean-field Ising model from a single nonequilibrium trajectory. We also demonstrate the robustness and efficiency of the approach with an application to a Bayesian model comparison problem of the type encountered in astrophysics and machine learning.
References in corpus (14)
- A nonequilibrium equality for free energy differences
- Active Particles in Complex and Crowded Environments
- Simulated Tempering: A New Monte Carlo Scheme
- Motility-Induced Phase Separation
- Multimodal nested sampling: an efficient and robust alternative to MCMC methods for astronomical data analysis
- Parallel Tempering: Theory, Applications, and New Perspectives
- Forward Flux Sampling for rare event simulations
- Generalized event-chain Monte Carlo: Constructing rejection-free global-balance algorithms from infinitesimal steps
- Rejection-free Monte-Carlo sampling for general potentials
- Nonequilibrium candidate Monte Carlo: A new tool for efficient equilibrium simulation
- Numerical calculation of granular entropy
- Turning intractable counting into sampling: computing the configurational entropy of three-dimensional jammed packings
- Superposition Enhanced Nested Sampling
- Simulated Tempering Method in the Infinite Switch Limit with Adaptive Weight Learning
Cited by in corpus (8)
- Nested sampling for physical scientists
- Differentiable Molecular Simulations for Control and Learning
- Physics-informed graph neural networks enhance scalability of variational nonequilibrium optimal control
- Efficient Bayesian Sampling Using Normalizing Flows to Assist Markov Chain Monte Carlo Methods
- NEO: Non Equilibrium Sampling on the Orbit of a Deterministic Transform
- Accelerated Jarzynski Estimator with Deterministic Virtual Trajectories
- A gentle introduction to the non-equilibrium physics of trajectories: Theory, algorithms, and biomolecular applications
- Hamiltonian Dynamics with Non-Newtonian Momentum for Rapid Sampling