Who Are We Missing? A Principled Approach to Characterizing the Underrepresented Population

Abstract

Randomized controlled trials (RCTs) serve as the cornerstone for understanding causal effects, yet extending inferences to target populations presents challenges due to effect heterogeneity and underrepresentation. Our paper addresses the critical issue of identifying and characterizing underrepresented subgroups in RCTs, proposing a novel framework for refining target populations to improve generalizability. We introduce an optimization-based approach, Rashomon Set of Optimal Trees (ROOT), to characterize underrepresented groups. ROOT optimizes the target subpopulation distribution by minimizing the variance of the target average treatment effect estimate, ensuring more precise treatment effect estimations. Notably, ROOT generates interpretable characteristics of the underrepresented population, aiding researchers in effective communication. Our approach demonstrates improved precision and interpretability compared to alternatives, as illustrated with synthetic data experiments. We apply our methodology to extend inferences from the Starting Treatment with Agonist Replacement Therapies (START) trial -- investigating the effectiveness of medication for opioid use disorder -- to the real-world population represented by the Treatment Episode Dataset: Admissions (TEDS-A). By refining target populations using ROOT, our framework offers a systematic approach to enhance decision-making accuracy and inform future trials in diverse populations.

MOUD Analysis Included

References in corpus (9)

• BART: Bayesian additive regression trees
• A Review of Generalizability and Transportability
• Sensitivity analysis for an unobserved moderator in RCT-to-target-population generalization of treatment effects
• On the Existence of Simpler Machine Learning Models
• Generalized and Scalable Optimal Sparse Decision Trees
• Exploring the Whole Rashomon Set of Sparse Decision Trees
• Wide-minima Density Hypothesis and the Explore-Exploit Learning Rate Schedule
• Covariate Balancing Sensitivity Analysis for Extrapolating Randomized Trials across Locations
• Improving efficiency in transporting average treatment effects