A New Step-down Procedure for Simultaneous Hypothesis Testing Under Dependence

Abstract

In this article, we consider the problem of simultaneous testing of hypotheses when the individual test statistics are not necessarily independent. Specifically, we consider the problem of simultaneous testing of point null hypotheses against two-sided alternatives for the mean parameters of normally distributed random variables. We assume that conditionally given the vector of means, these random variables jointly follow a multivariate normal distribution with a known but arbitrary covariance matrix. We consider a Bayesian framework where each unknown mean parameter is modeled through a two-component "spike and slab" mixture prior. This way, unconditionally the test statistics jointly have a mixture of multivariate normal distributions. A new testing procedure is developed that uses the dependence among the test statistics and works in a "step-down" manner. This procedure is general enough to be applied for non-normal data. A decision theoretic justification in favor of the proposed testing procedure has been provided by showing that unlike many traditional p-value based stepwise procedures, this new method possesses a certain "convexity property" which makes it admissible with respect to a vector risk function that captures the risks for the individual testing problems. An alternative representation of the proposed test statistics has also been established resulting in great simplification in the computational complexity. It is demonstrated through extensive simulations that for various forms of dependence and a wide range of sparsity levels, the proposed testing procedure compares quite favorably with several existing multiple testing procedures available in the literature in terms of overall misclassification probability.

References in corpus (13)

• Bayes and empirical-Bayes multiplicity adjustment in the variable-selection problem
• Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses
• Control of the mean number of false discoveries, Bonferroni and stability of multiple testing
• An adaptive step-down procedure with proven FDR control under independence
• On the false discovery rate and an asymptotically optimal rejection curve
• Stepup procedures for control of generalizations of the familywise error rate
• A comparison of the Benjamini-Hochberg procedure with some Bayesian rules for multiple testing
• Adaptive FDR control under independence and dependence
• Decision theory results for one-sided multiple comparison procedures
• On a generalized false discovery rate
• Characterization of Bayes procedures for multiple endpoint problems and inadmissibility of the step-up procedure
• A new multiple testing method in the dependent case
• False discovery rate control with multivariate $p$-values