The inefficiency of re-weighted sampling and the curse of system size in high order path integration

Abstract

Computing averages over a target probability density by statistical re-weighting of a set of samples with a different distribution is a strategy which is commonly adopted in fields as diverse as atomistic simulation and finance. Here we present a very general analysis of the accuracy and efficiency of this approach, highlighting some of its weaknesses. We then give an example of how our results can be used, specifically to assess the feasibility of high-order path integral methods. We demonstrate that the most promising of these techniques -- which is based on re-weighted sampling -- is bound to fail as the size of the system is increased, because of the exponential growth of the statistical uncertainty in the re-weighted average.

References in corpus (4)

• Canonical sampling through velocity-rescaling
• Competing quantum effects in the dynamics of a flexible water model
• Efficient stochastic thermostatting of path integral molecular dynamics
• Accelerating the convergence of path integral dynamics with a generalized Langevin equation

Cited by in corpus (17)

• Nuclear quantum effects enter the mainstream
• i-PI 2.0: A Universal Force Engine for Advanced Molecular Simulations
• Unsupervised machine learning in atomistic simulations, between predictions and understanding
• Efficient methods and practical guidelines for simulating isotope effects
• Combining simulations and solution experiments as a paradigm for RNA force field refinement
• Uncertainty estimation for molecular dynamics and sampling
• Ab initio molecular dynamics with nuclear quantum effects at classical cost: ring polymer contraction for density functional theory
• Computing the Absolute Gibbs Free Energy in Atomistic Simulations: Applications to Defects in Solids
• Accurate molecular dynamics and nuclear quantum effects at low cost by multiple steps in real and imaginary time: using density functional theory to accelerate wavefunction methods
• High Order Path Integrals Made Easy
• i-PI 3.0: a flexible and efficient framework for advanced atomistic simulations
• Direct path integral estimators for isotope fractionation ratios
• Modeling the structural and thermal properties of loaded metal-organic frameworks. An interplay of quantum and anharmonic fluctuations
• chemtrain: Learning Deep Potential Models via Automatic Differentiation and Statistical Physics
• Monte Carlo evaluation of the equilibrium isotope effects using the Takahashi-Imada factorization of the Feynman path integral
• Accelerating quantum instanton calculations of the kinetic isotope effects
• Two-dimensional electronic spectroscopy in the condensed phase using equivariant transformer accelerated molecular dynamics simulations