An exhaustive ADDIS principle for online FWER control

Abstract

In this paper we consider online multiple testing with familywise error rate (FWER) control, where the probability of committing at least one type I error shall remain under control while testing a possibly infinite sequence of hypotheses over time. Currently, Adaptive-Discard (ADDIS) procedures seem to be the most promising online procedures with FWER control in terms of power. Now, our main contribution is a uniform improvement of the ADDIS principle and thus of all ADDIS procedures. This means, the methods we propose reject as least as much hypotheses as ADDIS procedures and in some cases even more, while maintaining FWER control. In addition, we show that there is no other FWER controlling procedure that enlarges the event of rejecting any hypothesis. Finally, we apply the new principle to derive uniform improvements of the ADDIS-Spending and ADDIS-Graph.

References in corpus (4)

• Only Closed Testing Procedures are Admissible for Controlling False Discovery Proportions
• Sequential algorithmic modification with test data reuse
• Multiple testing when many $p$-values are uniformly conservative, with application to testing qualitative interaction in educational interventions
• Approval policies for modifications to Machine Learning-Based Software as a Medical Device: A study of bio-creep

Cited by in corpus (1)

• Treatment-control comparisons in platform trials including non-concurrent controls