BONuS: Multiple multivariate testing with a data-adaptivetest statistic
arXiv:2106.15743
Abstract
We propose a new adaptive empirical Bayes framework, the Bag-Of-Null-Statistics (BONuS) procedure, for multiple testing where each hypothesis testing problem is itself multivariate or nonparametric. BONuS is an adaptive and interactive knockoff-type method that helps improve the testing power while controlling the false discovery rate (FDR), and is closely connected to the "counting knockoffs" procedure analyzed in Weinstein et al. (2017). Contrary to procedures that start with a -value for each hypothesis, our method analyzes the entire data set to adaptively estimate an optimal -value transform based on an empirical Bayes model. Despite the extra adaptivity, our method controls FDR in finite samples even if the empirical Bayes model is incorrect or the estimation is poor. An extension, the Double BONuS procedure, validates the empirical Bayes model to guard against power loss due to model misspecification.
References in corpus (8)
- On the Benjamini--Hochberg method
- STAR: A general interactive framework for FDR control under structural constraints
- Multiple testing with the structure adaptive Benjamini-Hochberg algorithm
- A Power and Prediction Analysis for Knockoffs with Lasso Statistics
- A Generalized Benjamini-Hochberg Procedure for Multivariate Hypothesis Testing
- DAGGER: A sequential algorithm for FDR control on DAGs
- A New Approach for Large Scale Multiple Testing with Application to FDR Control for Graphically Structured Hypotheses
- Family learning: nonparametric statistical inference with parametric efficiency