Uniformly consistently estimating the proportion of false null hypotheses via Lebesgue-Stieltjes integral equations
arXiv:1807.03889 · doi:10.1016/j.jmva.2019.06.003
Abstract
The proportion of false null hypotheses is a very important quantity in statistical modelling and inference based on the two-component mixture model and its extensions, and in control and estimation of the false discovery rate and false non-discovery rate. Most existing estimators of this proportion threshold p-values, deconvolve the mixture model under constraints on its components, or depend heavily on the location-shift property of distributions. Hence, they usually are not consistent, applicable to non-location-shift distributions, or applicable to discrete statistics or p-values. To eliminate these shortcomings, we construct uniformly consistent estimators of the proportion as solutions to Lebesgue-Stieltjes integral equations. In particular, we provide such estimators respectively for random variables whose distributions have Riemann-Lebesgue type characteristic functions, form discrete natural exponential families with infinite supports, and form natural exponential families with separable moment sequences. We provide the speed of convergence and uniform consistency class for each such estimator under independence. In addition, we provide example distribution families for which a consistent estimator of the proportion cannot be constructed using our techniques.
arXiv comment44 pages in single spacing; 5 figures; proofs moved to supplementary materials; extended Introduction and Discussion; added a Simulation Study; accepted by Journal of Multivariate Analysis
References in corpus (8)
- A stochastic process approach to false discovery control
- Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses
- False discovery and false nondiscovery rates in single-step multiple testing procedures
- Optimal rates of convergence for estimating the null density and proportion of nonnull effects in large-scale multiple testing
- Multiple testing with discrete data: proportion of true null hypotheses and two adaptive FDR procedures
- A weighted FDR procedure under discrete and heterogeneous null distributions
- Consistent Estimation of Low-Dimensional Latent Structure in High-Dimensional Data
- A generalized Fourier approach to estimating the null parameters and proportion of non-null effects in large-scale multiple testing