Control functionals for Monte Carlo integration
arXiv:1410.2392
Abstract
A non-parametric extension of control variates is presented. These leverage gradient information on the sampling density to achieve substantial variance reduction. It is not required that the sampling density be normalised. The novel contribution of this work is based on two important insights; (i) a trade-off between random sampling and deterministic approximation and (ii) a new gradient-based function space derived from Stein's identity. Unlike classical control variates, our estimators achieve super-root- convergence, often requiring orders of magnitude fewer simulations to achieve a fixed level of precision. Theoretical and empirical results are presented, the latter focusing on integration problems arising in hierarchical models and models based on non-linear ordinary differential equations.
arXiv commentAccepted for publication in J. R. Statist. Soc. B
References in corpus (14)
- Zero-variance principle for Monte Carlo algorithms
- Zero-Variance Zero-Bias Principle for Observables in quantum Monte Carlo: Application to Forces
- Composite Gaussian process models for emulating expensive functions
- Dynamics of Elastic Excitable Media
- Measuring Sample Quality with Stein's Method
- Zero Variance Markov Chain Monte Carlo for Bayesian Estimators
- Sampling for Inference in Probabilistic Models with Fast Bayesian Quadrature
- Frank-Wolfe Bayesian Quadrature: Probabilistic Integration with Theoretical Guarantees
- Optimally-Weighted Herding is Bayesian Quadrature
- Sequential Kernel Herding: Frank-Wolfe Optimization for Particle Filtering
- The Controlled Thermodynamic Integral for Bayesian Model Comparison
- Proximal Markov chain Monte Carlo algorithms
- Kernel Mean Estimation via Spectral Filtering
- A constraint on extensible quadrature rules