Confidence and discoveries with e-values
arXiv:1912.13292 · doi:10.1214/22-STS874
Abstract
We discuss systematically two versions of confidence regions: those based on p-values and those based on e-values, a recent alternative to p-values. Both versions can be applied to multiple hypothesis testing, and in this paper we are interested in procedures that control the number of false discoveries under arbitrary dependence between the base p- or e-values. We introduce a procedure that is based on e-values and show that it is efficient both computationally and statistically using simulated and real-world datasets. Comparison with the corresponding standard procedure based on p-values is not straightforward, but there are indications that the new one performs significantly better in some situations.
arXiv comment50 pages, 13 figures, and 5 tables
References in corpus (9)
- A stochastic process approach to false discovery control
- E-values: Calibration, combination, and applications
- Multiple Testing for Exploratory Research
- Control of generalized error rates in multiple testing
- Exact testing with random permutations
- Simultaneous Control of All False Discovery Proportions in Large-Scale Multiple Hypothesis Testing
- Permutation-based simultaneous confidence bounds for the false discovery proportion
- Only Closed Testing Procedures are Admissible for Controlling False Discovery Proportions
- True and false discoveries with independent and sequential e-values