Asymptotic Bayes-optimality under sparsity of some multiple testing procedures

Abstract

Within a Bayesian decision theoretic framework we investigate some asymptotic optimality properties of a large class of multiple testing rules. A parametric setup is considered, in which observations come from a normal scale mixture model and the total loss is assumed to be the sum of losses for individual tests. Our model can be used for testing point null hypotheses, as well as to distinguish large signals from a multitude of very small effects. A rule is defined to be asymptotically Bayes optimal under sparsity (ABOS), if within our chosen asymptotic framework the ratio of its Bayes risk and that of the Bayes oracle (a rule which minimizes the Bayes risk) converges to one. Our main interest is in the asymptotic scheme where the proportion p of "true" alternatives converges to zero. We fully characterize the class of fixed threshold multiple testing rules which are ABOS, and hence derive conditions for the asymptotic optimality of rules controlling the Bayesian False Discovery Rate (BFDR). We finally provide conditions under which the popular Benjamini-Hochberg (BH) and Bonferroni procedures are ABOS and show that for a wide class of sparsity levels, the threshold of the former can be approximated by a nonrandom threshold.

Published in at http://dx.doi.org/10.1214/10-AOS869 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org)

References in corpus (14)

• Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem
• Microarrays, Empirical Bayes and the Two-Groups Model
• A multivariate empirical Bayes statistic for replicated microarray time course data
• On the false discovery rate and an asymptotically optimal rejection curve
• A comparison of the Benjamini-Hochberg procedure with some Bayesian rules for multiple testing
• Asymptotic Bayes-optimality under sparsity of some multiple testing procedures
• Estimation and confidence sets for sparse normal mixtures
• Optimal weighting for false discovery rate control
• False discovery and false nondiscovery rates in single-step multiple testing procedures
• Asymptotic minimaxity of False Discovery Rate thresholding for sparse exponential data
• Optimal rates of convergence for estimating the null density and proportion of nonnull effects in large-scale multiple testing
• Power-enhanced multiple decision functions controlling family-wise error and false discovery rates
• On the performance of FDR control: Constraints and a partial solution
• False discovery rate control with multivariate $p$-values

Cited by in corpus (17)

• SLOPE - Adaptive variable selection via convex optimization
• Higher Criticism for Large-Scale Inference, Especially for Rare and Weak Effects
• Asymptotic Bayes-optimality under sparsity of some multiple testing procedures
• Asymptotically minimax empirical Bayes estimation of a sparse normal mean vector
• A nonparametric empirical Bayes framework for large-scale multiple testing
• Sequential multiple testing with generalized error control: an asymptotic optimality theory
• On false discovery rate thresholding for classification under sparsity
• Analyzing genome-wide association studies with an FDR controlling modification of the Bayesian information criterion
• Large-Scale Multiple Hypothesis Testing with the Normal-Beta Prime Prior
• Empirical priors and coverage of posterior credible sets in a sparse normal mean model
• On nonparametric estimation of a mixing density via the predictive recursion algorithm
• Testing Un-Separated Hypotheses by Estimating a Distance
• Classes of Multiple Decision Functions Strongly Controlling FWER and FDR
• Sparse Portfolio selection via Bayesian Multiple testing
• Simultaneous Selection of Multiple Important Single Nucleotide Polymorphisms in Familial Genome Wide Association Studies Data
• Effect of global shrinkage parameter of horseshoe prior in compressed sensing
• Posterior Contraction rate and Asymptotic Bayes Optimality for one-group shrinkage priors in sparse normal means problem