Effective Sample Size for Importance Sampling based on discrepancy measures

Abstract

The Effective Sample Size (ESS) is an important measure of efficiency of Monte Carlo methods such as Markov Chain Monte Carlo (MCMC) and Importance Sampling (IS) techniques. In the IS context, an approximation $\widehat{ESS}$ of the theoretical ESS definition is widely applied, involving the inverse of the sum of the squares of the normalized importance weights. This formula, $\widehat{ESS}$, has become an essential piece within Sequential Monte Carlo (SMC) methods, to assess the convenience of a resampling step. From another perspective, the expression $\widehat{ESS}$ is related to the Euclidean distance between the probability mass described by the normalized weights and the discrete uniform probability mass function (pmf). In this work, we derive other possible ESS functions based on different discrepancy measures between these two pmfs. Several examples are provided involving, for instance, the geometric mean of the weights, the discrete entropy (including theperplexity measure, already proposed in literature) and the Gini coefficient among others. We list five theoretical requirements which a generic ESS function should satisfy, allowing us to classify different ESS measures. We also compare the most promising ones by means of numerical simulations.

References in corpus (6)

• Adaptive Importance Sampling in General Mixture Classes
• On adaptive resampling strategies for sequential Monte Carlo methods
• Generalized Multiple Importance Sampling
• Cooperative Parallel Particle Filters for online model selection and applications to Urban Mobility
• Improving Population Monte Carlo: Alternative Weighting and Resampling Schemes
• Importance Sampling: Intrinsic Dimension and Computational Cost

Cited by in corpus (46)

• A NICER View of the Massive Pulsar PSR J0740+6620 Informed by Radio Timing and XMM-Newton Spectroscopy
• A Survey of Monte Carlo Methods for Parameter Estimation
• Kernel Risk-Sensitive Loss: Definition, Properties and Application to Robust Adaptive Filtering
• Cooperative Parallel Particle Filters for online model selection and applications to Urban Mobility
• Using the Maximum Entropy Principle to Combine Simulations and Solution Experiments
• Dark Energy Survey Year 3 Results: Covariance Modelling and its Impact on Parameter Estimation and Quality of Fit
• A Review of Multiple Try MCMC algorithms for Signal Processing
• Marginal likelihood computation for model selection and hypothesis testing: an extensive review
• Fewer Mocks and Less Noise: Reducing the Dimensionality of Cosmological Observables with Subspace Projections
• Rethinking the Effective Sample Size
• Group Importance Sampling for Particle Filtering and MCMC
• Phase Space Sampling and Inference from Weighted Events with Autoregressive Flows
• Importance Gaussian Quadrature
• VAMANA: Modeling Binary Black Hole Population with Minimal Assumptions
• Implicitly Adaptive Importance Sampling
• VARAHA: A Fast Non-Markovian sampler for estimating Gravitational-Wave posteriors
• Solving Schrödinger Bridges via Maximum Likelihood
• Activity-induced phase transition in a quantum many-body system
• Robust Covariance Adaptation in Adaptive Importance Sampling
• Path Weight Sampling: Exact Monte Carlo Computation of the Mutual Information between Stochastic Trajectories
• Iterative importance sampling with Markov chain Monte Carlo sampling in robust Bayesian analysis
• Automatic maneuver detection and tracking of space objects in optical survey scenarios based on stochastic hybrid systems formulation
• Bayesian Variational Autoencoders for Unsupervised Out-of-Distribution Detection
• PriorVAE: Encoding spatial priors with VAEs for small-area estimation
• Online Particle Smoothing with Application to Map-matching
• Effective Sample Size, Dimensionality, and Generalization in Covariate Shift Adaptation
• Guided sequential ABC schemes for intractable Bayesian models
• SIDIS-RC EvGen: a Monte-Carlo event generator of semi-inclusive deep inelastic scattering with the lowest-order QED radiative corrections
• Importance Resampling for Off-policy Prediction
• Analyzing Population-Level Trials as N-of-1 Trials: an Application to Gait
• Tree pyramidal adaptive importance sampling
• An index of effective number of variables for uncertainty and reliability analysis in model selection problems
• Flow Annealed Importance Sampling Bootstrap meets Differentiable Particle Physics
• Deep Importance Sampling based on Regression for Model Inversion and Emulation
• Adaptive posterior distributions for uncertainty analysis of covariance matrices in Bayesian inversion problems for multioutput signals
• Cluster Prediction for Opinion Dynamics from Partial Observations
• A Unification of Weighted and Unweighted Particle Filters
• Doubly Adaptive Importance Sampling
• Advances in Importance Sampling
• Exploring Variance Reduction in Importance Sampling for Efficient DNN Training
• Efficient Nested Simulation Experiment Design via the Likelihood Ratio Method
• Improving the Efficiency of Variationally Enhanced Sampling with Wavelet-Based Bias Potentials
• A Framework for the Bayesian Calibration of Complex and Data-Scarce Models in Applied Sciences
• Compressed particle methods for expensive models with application in Astronomy and Remote Sensing
• Effective sample size approximations as entropy measures
• Symmetrized importance samplers for stochastic differential equations