A stochastic process approach to false discovery control

Abstract

This paper extends the theory of false discovery rates (FDR) pioneered by Benjamini and Hochberg [J. Roy. Statist. Soc. Ser. B 57 (1995) 289-300]. We develop a framework in which the False Discovery Proportion (FDP)--the number of false rejections divided by the number of rejections--is treated as a stochastic process. After obtaining the limiting distribution of the process, we demonstrate the validity of a class of procedures for controlling the False Discovery Rate (the expected FDP). We construct a confidence envelope for the whole FDP process. From these envelopes we derive confidence thresholds, for controlling the quantiles of the distribution of the FDP as well as controlling the number of false discoveries. We also investigate methods for estimating the p-value distribution.

Cited by in corpus (46)

• Size, power and false discovery rates
• On the Benjamini--Hochberg method
• Generalizations of the Familywise Error Rate
• Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses
• Innovated higher criticism for detecting sparse signals in correlated noise
• Control of generalized error rates in multiple testing
• Robustness of multiple testing procedures against dependence
• On the false discovery rate and an asymptotically optimal rejection curve
• On false discovery control under dependence
• Stepup procedures for control of generalizations of the familywise error rate
• Asymptotic Bayes-optimality under sparsity of some multiple testing procedures
• Properties of higher criticism under strong dependence
• Estimation and confidence sets for sparse normal mixtures
• Covariate powered cross-weighted multiple testing
• Optimal weighting for false discovery rate control
• Dependency and false discovery rate: Asymptotics
• A New Perspective on Robust $M$-Estimation: Finite Sample Theory and Applications to Dependence-Adjusted Multiple Testing
• False discovery and false nondiscovery rates in single-step multiple testing procedures
• Post hoc inference via joint family-wise error rate control
• Stepup procedures controlling generalized FWER and generalized FDR
• Simultaneous Control of All False Discovery Proportions in Large-Scale Multiple Hypothesis Testing
• Optimal rates of convergence for estimating the null density and proportion of nonnull effects in large-scale multiple testing
• Permutation-based simultaneous confidence bounds for the false discovery proportion
• Multiple testing via $FD{R}_L$ for large-scale imaging data
• Simultaneous high-probability bounds on the false discovery proportion in structured, regression, and online settings
• Multiple Testing for Neuroimaging via Hidden Markov Random Field
• Only Closed Testing Procedures are Admissible for Controlling False Discovery Proportions
• Exact calculations for false discovery proportion with application to least favorable configurations
• On the performance of FDR control: Constraints and a partial solution
• Further results on controlling the false discovery proportion
• On false discovery rate thresholding for classification under sparsity
• On approximate validation of models: A Kolmogorov-Smirnov based approach
• Empirical null and false discovery rate inference for exponential families
• New procedures controlling the false discovery proportion via Romano-Wolf's heuristic
• Asymptotic properties of false discovery rate controlling procedures under independence
• Confidence and discoveries with e-values
• False discovery rate control with multivariate $p$-values
• Measuring support for a hypothesis about a random parameter without estimating its unknown prior
• Notip: Non-parametric True Discovery Proportion control for brain imaging
• Uniformly consistently estimating the proportion of false null hypotheses via Lebesgue-Stieltjes integral equations
• Simultaneous critical values for $t$-tests in very high dimensions
• A central limit theorem for the Benjamini-Hochberg false discovery proportion under a factor model
• Comment: Microarrays, Empirical Bayes and the Two-Group Model
• Feature-specific inference for penalized regression using local false discovery rates
• Box-constrained monotone $L_{\infty }$-approximations to Lipschitz regularizations, with applications to robust testing
• Comment: Microarrays, Empirical Bayes and the Two-Groups Model