Split Sampling: Expectations, Normalisation and Rare Events
arXiv:1212.0534
Abstract
In this paper we develop a methodology that we call split sampling methods to estimate high dimensional expectations and rare event probabilities. Split sampling uses an auxiliary variable MCMC simulation and expresses the expectation of interest as an integrated set of rare event probabilities. We derive our estimator from a Rao-Blackwellised estimate of a marginal auxiliary variable distribution. We illustrate our method with two applications. First, we compute a shortest network path rare event probability and compare our method to estimation to a cross entropy approach. Then, we compute a normalisation constant of a high dimensional mixture of Gaussians and compare our estimate to one based on nested sampling. We discuss the relationship between our method and other alternatives such as the product of conditional probability estimator and importance sampling. The methods developed here are available in the R package: SplitSampling.
References in corpus (6)
- An efficient, multiple range random walk algorithm to calculate the density of states
- Multicanonical Ensemble: A New Approach to Simulate First-order Phase Transitions
- Equi-energy sampler with applications in statistical inference and statistical mechanics
- Monte Carlo simulation and global optimization without parameters
- Zero Variance Markov Chain Monte Carlo for Bayesian Estimators
- Importance Tempering