STAR: A general interactive framework for FDR control under structural constraints
arXiv:1710.02776 · doi:10.1093/biomet/asaa064
Abstract
We propose a general framework based on selectively traversed accumulation rules (STAR) for interactive multiple testing with generic structural constraints on the rejection set. It combines accumulation tests from ordered multiple testing with data-carving ideas from post-selection inference, allowing for highly flexible adaptation to generic structural information. Our procedure defines an interactive protocol for gradually pruning a candidate rejection set, beginning with the set of all hypotheses and shrinking with each step. By restricting the information at each step via a technique we call masking, our protocol enables interaction while controlling the false discovery rate (FDR) in finite samples for any data-adaptive update rule that the analyst may choose. We suggest update rules for a variety of applications with complex structural constraints, show that STAR performs well for problems ranging from convex region detection to FDR control on directed acyclic graphs, and show how to extend it to regression problems where knockoff statistics are available in lieu of -values.
arXiv commentTo appear in Biometrika
References in corpus (7)
- Controlling the false discovery rate via knockoffs
- Optimal Inference After Model Selection
- Structured variable selection and estimation
- Power of Ordered Hypothesis Testing
- Online control of the false discovery rate with decaying memory
- Testing hypotheses on a tree: new error rates and controlling strategies
- On Procedures Controlling the FDR for Testing Hierarchically Ordered Hypotheses
Cited by in corpus (15)
- Simultaneous high-probability bounds on the false discovery proportion in structured, regression, and online settings
- Modern approaches for evaluating treatment effect heterogeneity from clinical trials and observational data
- Improving the Stability of the Knockoff Procedure: Multiple Simultaneous Knockoffs and Entropy Maximization
- AdaPT: An interactive procedure for multiple testing with side information
- DAGGER: A sequential algorithm for FDR control on DAGs
- False Discovery Rate Control Under General Dependence By Symmetrized Data Aggregation
- Interactive Martingale Tests for the Global Null
- BONuS: Multiple multivariate testing with a data-adaptive test statistic
- AdaPT-GMM: Powerful and robust covariate-assisted multiple testing
- Familywise Error Rate Control by Interactive Unmasking
- False Discovery Rates to Detect Signals from Incomplete Spatially Aggregated Data
- A Phylogeny-based Test of Mediation Effect in Microbiome
- Interactive identification of individuals with positive treatment effect while controlling false discoveries
- Controlling the False Discovery Rate in Complex Multi-Way Classified Hypotheses
- Conditional Randomization Rank Test