Locally Interpretable Models and Effects based on Supervised Partitioning (LIME-SUP)

Abstract

Supervised Machine Learning (SML) algorithms such as Gradient Boosting, Random Forest, and Neural Networks have become popular in recent years due to their increased predictive performance over traditional statistical methods. This is especially true with large data sets (millions or more observations and hundreds to thousands of predictors). However, the complexity of the SML models makes them opaque and hard to interpret without additional tools. There has been a lot of interest recently in developing global and local diagnostics for interpreting and explaining SML models. In this paper, we propose locally interpretable models and effects based on supervised partitioning (trees) referred to as LIME-SUP. This is in contrast with the KLIME approach that is based on clustering the predictor space. We describe LIME-SUP based on fitting trees to the fitted response (LIM-SUP-R) as well as the derivatives of the fitted response (LIME-SUP-D). We compare the results with KLIME and describe its advantages using simulation and real data.

arXiv comment15 pages, 10 figures

References in corpus (3)

• A Unified Approach to Interpreting Model Predictions
• Predictive learning via rule ensembles
• "Why Should I Trust You?": Explaining the Predictions of Any Classifier

Cited by in corpus (15)

• Interpretable Machine Learning -- A Brief History, State-of-the-Art and Challenges
• Explainable Neural Networks based on Additive Index Models
• Explainable Artificial Intelligence for Process Mining: A General Overview and Application of a Novel Local Explanation Approach for Predictive Process Monitoring
• On the Art and Science of Machine Learning Explanations
• Can I trust you more? Model-Agnostic Hierarchical Explanations
• Proposed Guidelines for the Responsible Use of Explainable Machine Learning
• Why model why? Assessing the strengths and limitations of LIME
• Model Explainability in Deep Learning Based Natural Language Processing
• Bias, Fairness, and Accountability with AI and ML Algorithms
• LIMEcraft: Handcrafted superpixel selection and inspection for Visual eXplanations
• Enhancing Explainability of Neural Networks through Architecture Constraints
• MeLIME: Meaningful Local Explanation for Machine Learning Models
• Model Interpretation: A Unified Derivative-based Framework for Nonparametric Regression and Supervised Machine Learning
• SurvLIME-Inf: A simplified modification of SurvLIME for explanation of machine learning survival models
• Adaptive Explainable Neural Networks (AxNNs)