STAR: A general interactive framework for FDR control under structural constraints

Abstract

We propose a general framework based on selectively traversed accumulation rules (STAR) for interactive multiple testing with generic structural constraints on the rejection set. It combines accumulation tests from ordered multiple testing with data-carving ideas from post-selection inference, allowing for highly flexible adaptation to generic structural information. Our procedure defines an interactive protocol for gradually pruning a candidate rejection set, beginning with the set of all hypotheses and shrinking with each step. By restricting the information at each step via a technique we call masking, our protocol enables interaction while controlling the false discovery rate (FDR) in finite samples for any data-adaptive update rule that the analyst may choose. We suggest update rules for a variety of applications with complex structural constraints, show that STAR performs well for problems ranging from convex region detection to FDR control on directed acyclic graphs, and show how to extend it to regression problems where knockoff statistics are available in lieu of $p$-values.

To appear in Biometrika

References in corpus (3)

• Structured variable selection and estimation
• Online control of the false discovery rate with decaying memory
• On Procedures Controlling the FDR for Testing Hierarchically Ordered Hypotheses

Cited by in corpus (14)

• Simultaneous high-probability bounds on the false discovery proportion in structured, regression, and online settings
• Modern approaches for evaluating treatment effect heterogeneity from clinical trials and observational data
• Improving the Stability of the Knockoff Procedure: Multiple Simultaneous Knockoffs and Entropy Maximization
• DAGGER: A sequential algorithm for FDR control on DAGs
• False Discovery Rate Control Under General Dependence By Symmetrized Data Aggregation
• Interactive Martingale Tests for the Global Null
• BONuS: Multiple multivariate testing with a data-adaptivetest statistic
• AdaPT-GMM: Powerful and robust covariate-assisted multiple testing
• Familywise Error Rate Control by Interactive Unmasking
• A Phylogeny-based Test of Mediation Effect in Microbiome
• False Discovery Rates to Detect Signals from Incomplete Spatially Aggregated Data
• Interactive identification of individuals with positive treatment effect while controlling false discoveries
• Controlling the False Discovery Rate in Complex Multi-Way Classified Hypotheses
• Conditional Randomization Rank Test