The Online Closure Principle
arXiv:2211.11400 · doi:10.1214/24-AOS2370
Abstract
The closure principle is fundamental in multiple testing and has been used to derive many efficient procedures with familywise error rate control. However, it is often unsuitable for modern research, which involves flexible multiple testing settings where not all hypotheses are known at the beginning of the evaluation. In this paper, we focus on online multiple testing where a possibly infinite sequence of hypotheses is tested over time. At each step, it must be decided on the current hypothesis without having any information about the hypotheses that have not been tested yet. Our main contribution is a general and stringent mathematical definition of online multiple testing and a new online closure principle which ensures that the resulting closed procedure can be applied in the online setting. We prove that any familywise error rate controlling online procedure can be derived by this online closure principle and provide admissibility results. In addition, we demonstrate how short-cuts of these online closed procedures can be obtained under a suitable consonance property.
21 pages, 8 figures
References in corpus (6)
- Only Closed Testing Procedures are Admissible for Controlling False Discovery Proportions
- Online control of the false discovery rate with decaying memory
- ADDIS: an adaptive discarding algorithm for online FDR control with conservative nulls
- Graphical approaches for the control of generalised error rates
- Sequential algorithmic modification with test data reuse
- The Power of Batching in Multiple Hypothesis Testing