Inconsistency of bootstrap: The Grenander estimator
arXiv:1010.3825 · doi:10.1214/09-AOS777
Abstract
In this paper, we investigate the (in)-consistency of different bootstrap methods for constructing confidence intervals in the class of estimators that converge at rate . The Grenander estimator, the nonparametric maximum likelihood estimator of an unknown nonincreasing density function on , is a prototypical example. We focus on this example and explore different approaches to constructing bootstrap confidence intervals for , where is an interior point. We find that the bootstrap estimate, when generating bootstrap samples from the empirical distribution function or its least concave majorant , does not have any weak limit in probability. We provide a set of sufficient conditions for the consistency of any bootstrap method in this example and show that bootstrapping from a smoothed version of leads to strongly consistent estimators. The out of bootstrap method is also shown to be consistent while generating samples from and .
Published in at http://dx.doi.org/10.1214/09-AOS777 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)