Bayesian Probabilistic Numerical Integration with Tree-Based Models

Abstract

Bayesian quadrature (BQ) is a method for solving numerical integration problems in a Bayesian manner, which allows users to quantify their uncertainty about the solution. The standard approach to BQ is based on a Gaussian process (GP) approximation of the integrand. As a result, BQ is inherently limited to cases where GP approximations can be done in an efficient manner, thus often prohibiting very high-dimensional or non-smooth target functions. This paper proposes to tackle this issue with a new Bayesian numerical integration algorithm based on Bayesian Additive Regression Trees (BART) priors, which we call BART-Int. BART priors are easy to tune and well-suited for discontinuous functions. We demonstrate that they also lend themselves naturally to a sequential design setting and that explicit convergence rates can be obtained in a variety of settings. The advantages and disadvantages of this new methodology are highlighted on a set of benchmark tests including the Genz functions, and on a Bayesian survey design problem.

References in corpus (14)

• GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Acceleration
• Rates of contraction of posterior distributions based on Gaussian process priors
• Discussion on "Bayesian Regression Tree Models for Causal Inference: Regularization, Confounding, and Heterogeneous Effects" by Hahn, Murray and Carvalho
• Adaptive Multidimensional Integration: VEGAS Enhanced
• Sampling for Inference in Probabilistic Models with Fast Bayesian Quadrature
• Fast Automatic Bayesian Cubature Using Lattice Sampling
• XBART: Accelerated Bayesian Additive Regression Trees
• Adaptive quadrature schemes for Bayesian inference via active learning
• Uncertainty Quantification for Sparse Deep Learning
• Convergence Guarantees for Adaptive Bayesian Quadrature Methods
• Convergence Guarantees for Gaussian Process Means With Misspecified Likelihoods and Smoothness
• Model Evidence with Fast Tree Based Quadrature
• On Semi-parametric Bernstein-von Mises Theorems for BART
• Tree pyramidal adaptive importance sampling