TimberTrek: Exploring and Curating Sparse Decision Trees with Interactive Visualization

Abstract

Given thousands of equally accurate machine learning (ML) models, how can users choose among them? A recent ML technique enables domain experts and data scientists to generate a complete Rashomon set for sparse decision trees--a huge set of almost-optimal interpretable ML models. To help ML practitioners identify models with desirable properties from this Rashomon set, we develop TimberTrek, the first interactive visualization system that summarizes thousands of sparse decision trees at scale. Two usage scenarios highlight how TimberTrek can empower users to easily explore, compare, and curate models that align with their domain knowledge and values. Our open-source tool runs directly in users' computational notebooks and web browsers, lowering the barrier to creating more responsible ML models. TimberTrek is available at the following public demo link: https://poloclub.github.io/timbertrek.

arXiv commentAccepted at IEEE VIS 2022. 5 pages, 6 figures. For a demo video, see https://youtu.be/3eGqTmsStJM. For a live demo, visit https://poloclub.github.io/timbertrek

References in corpus (9)

• All Models are Wrong, but Many are Useful: Learning a Variable's Importance by Studying an Entire Class of Prediction Models Simultaneously
• The State of the Art in Enhancing Trust in Machine Learning Models with the Use of Visualizations
• StackGenVis: Alignment of Data, Algorithms, and Models for Stacking Ensemble Learning Using Performance Metrics
• Explainable Matrix -- Visualization for Global and Local Interpretability of Random Forest Classification Ensembles
• Learning Optimized Risk Scores
• StickyLand: Breaking the Linear Presentation of Computational Notebooks
• VisRuler: Visual Analytics for Extracting Decision Rules from Bagged and Boosted Decision Trees
• GAM Changer: Editing Generalized Additive Models with Interactive Visualization
• Forward Stability and Model Path Selection

Cited by in corpus (5)

• Notable: On-the-fly Assistant for Data Storytelling in Computational Notebooks
• GAM Coach: Towards Interactive and User-centered Algorithmic Recourse
• SuperNOVA: Design Strategies and Opportunities for Interactive Visualization in Computational Notebooks
• WebSHAP: Towards Explaining Any Machine Learning Models Anywhere
• AI-Spectra: A Visual Dashboard for Model Multiplicity to Enhance Informed and Transparent Decision-Making