Global Model Interpretation via Recursive Partitioning
arXiv:1802.04253
Abstract
In this work, we propose a simple but effective method to interpret black-box machine learning models globally. That is, we use a compact binary tree, the interpretation tree, to explicitly represent the most important decision rules that are implicitly contained in the black-box machine learning models. This tree is learned from the contribution matrix which consists of the contributions of input variables to predicted scores for each single prediction. To generate the interpretation tree, a unified process recursively partitions the input variable space by maximizing the difference in the average contribution of the split variable between the divided spaces. We demonstrate the effectiveness of our method in diagnosing machine learning models on multiple tasks. Also, it is useful for new knowledge discovery as such insights are not easily identifiable when only looking at single predictions. In general, our work makes it easier and more efficient for human beings to understand machine learning models.
arXiv commentAccepted by The 4th IEEE International Conference on Data Science and Systems (DSS-2018)
References in corpus (5)
- Recursive Partitioning for Heterogeneous Causal Effects
- Understanding Black-box Predictions via Influence Functions
- Interpretable classifiers using rules and Bayesian analysis: Building a better stroke prediction model
- Places: An Image Database for Deep Scene Understanding
- Visual Explanations From Deep 3D Convolutional Neural Networks for Alzheimer's Disease Classification
Cited by in corpus (5)
- A Survey on the Explainability of Supervised Machine Learning
- Visual Explanations From Deep 3D Convolutional Neural Networks for Alzheimer's Disease Classification
- Explainable AI for Interpretable Credit Scoring
- Global Explanations of Neural Networks: Mapping the Landscape of Predictions
- Toward Machine-Guided, Human-Initiated Explanatory Interactive Learning