Integral approximation by kernel smoothing

Abstract

Let $(X_1,\dots ,X_n)$ be an i.i.d. sequence of random variables in ${\mathbb{R}}^d$, $d\ge 1$. We show that, for any function $\phi :{\mathbb{R}}^d\to \mathbb{R}$, under regularity conditions, \[n^ {1/2}\Biggl(n^{-1}\sum_{i=1}^n\frac{φ(X_i)}{\widehat{f}^(X_i)}- \int φ(x)\,dx\Biggr)\stackrel{\mathbb{P}}{\longrightarrow}0,\] where $\hat{f}$ is the classical kernel estimator of the density of $X_1$. This result is striking because it speeds up traditional rates, in root $n$, derived from the central limit theorem when $\hat{f}=f$. Although this paper highlights some applications, we mainly address theoretical issues related to the later result. We derive upper bounds for the rate of convergence in probability. These bounds depend on the regularity of the functions $\phi$ and $f$, the dimension $d$ and the bandwidth of the kernel estimator $\hat{f}$. Moreover, they are shown to be accurate since they are used as renormalizing sequences in two central limit theorems each reflecting different degrees of smoothness of $\phi$. As an application to regression modelling with random design, we provide the asymptotic normality of the estimation of the linear functionals of a regression function. As a consequence of the above result, the asymptotic variance does not depend on the regression function. Finally, we debate the choice of the bandwidth for integral approximation and we highlight the good behavior of our procedure through simulations.

Published at http://dx.doi.org/10.3150/15-BEJ725 in the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm). arXiv admin note: text overlap with arXiv:1312.4497

References in corpus (1)

• Semi-parametric estimation of shifts

Cited by in corpus (7)

• Learning to Draw Samples: With Application to Amortized MLE for Generative Adversarial Learning
• Adaptive quadrature schemes for Bayesian inference via active learning
• On two ways to use determinantal point processes for Monte Carlo integration
• Importance Sampling Policy Evaluation with an Estimated Behavior Policy
• Sensitivity analysis from a single input/output sample
• Probabilistic Models for Integration Error in the Assessment of Functional Cardiac Models
• Doubly Robust Off-Policy Actor-Critic Algorithms for Reinforcement Learning