9 papers
ArborEnum: Decision Tree Rashomon Sets over Continuous Features
Zakk Heile, Hayden McTavish, Margo Seltzer +1
The Rashomon effect describes the phenomenon that many models can achieve nearly equivalent performance on the same learning task, with significant ramifications for robustness, fe…
Multistage Defer Trees for Hybrid Interpretability: If at First You Can't Succeed, Tree Again
Zakk Heile, Hayden McTavish, Margo Seltzer +1
Recent work has shown that well-optimized individual decision trees can match complex black box models in some settings, primarily in noisy domains. For the remaining settings, how…
CLARITree: Cholesky and Lookahead Accelerations for Regression with Interpretable Piecewise Linear Trees
Yixiao Wang, Hayden McTavish, Varun Babbar +2
Regression trees are among the most interpretable yet expressive model classes in machine learning. Historically, greedy induction has been the dominant approach for constructing w…
From Rashomon Theory to PRAXIS: Efficient Decision Tree Rashomon Sets
Zakk Heile, Hayden McTavish, Varun Babbar +2
Standard machine learning pipelines often admit many near-optimal models. These "Rashomon sets" pose a range of challenges and opportunities for uncertainty-aware, robust decision…
REALITrees: Rashomon Ensemble Active Learning for Interpretable Trees
Simon D. Nguyen, Hayden McTavish, Kentaro Hoffman +2
Active learning reduces labeling costs by selecting samples that maximize information gain. A dominant framework, Query-by-Committee (QBC), typically relies on perturbation-based d…
Interpretable Generalized Additive Models for Datasets with Missing Values
Hayden McTavish, Jon Donnelly, Margo Seltzer +1
Many important datasets contain samples that are missing one or more feature values. Maintaining the interpretability of machine learning models in the presence of such missing dat…