7 papers
ArborEnum: Decision Tree Rashomon Sets over Continuous Features
Zakk Heile, Hayden McTavish, Margo Seltzer +1
The Rashomon effect describes the phenomenon that many models can achieve nearly equivalent performance on the same learning task, with significant ramifications for robustness, fe…
Resolving Predictive Multiplicity for the Rashomon Set
Parian Haghighat, Hadis Anahideh, Cynthia Rudin
The existence of multiple, equally accurate models for a given predictive task leads to predictive multiplicity, where a Rashomon set of models achieve similar accuracy but diverge…
Multistage Defer Trees for Hybrid Interpretability: If at First You Can't Succeed, Tree Again
Zakk Heile, Hayden McTavish, Margo Seltzer +1
Recent work has shown that well-optimized individual decision trees can match complex black box models in some settings, primarily in noisy domains. For the remaining settings, how…
CLARITree: Cholesky and Lookahead Accelerations for Regression with Interpretable Piecewise Linear Trees
Yixiao Wang, Hayden McTavish, Varun Babbar +2
Regression trees are among the most interpretable yet expressive model classes in machine learning. Historically, greedy induction has been the dominant approach for constructing w…
From Rashomon Theory to PRAXIS: Efficient Decision Tree Rashomon Sets
Zakk Heile, Hayden McTavish, Varun Babbar +2
Standard machine learning pipelines often admit many near-optimal models. These "Rashomon sets" pose a range of challenges and opportunities for uncertainty-aware, robust decision…
REALITrees: Rashomon Ensemble Active Learning for Interpretable Trees
Simon D. Nguyen, Hayden McTavish, Kentaro Hoffman +2
Active learning reduces labeling costs by selecting samples that maximize information gain. A dominant framework, Query-by-Committee (QBC), typically relies on perturbation-based d…