Ensembles of Random SHAPs
arXiv:2103.03302
Abstract
Ensemble-based modifications of the well-known SHapley Additive exPlanations (SHAP) method for the local explanation of a black-box model are proposed. The modifications aim to simplify SHAP which is computationally expensive when there is a large number of features. The main idea behind the proposed modifications is to approximate SHAP by an ensemble of SHAPs with a smaller number of features. According to the first modification, called ER-SHAP, several features are randomly selected many times from the feature set, and Shapley values for the features are computed by means of "small" SHAPs. The explanation results are averaged to get the final Shapley values. According to the second modification, called ERW-SHAP, several points are generated around the explained instance for diversity purposes, and results of their explanation are combined with weights depending on distances between points and the explained instance. The third modification, called ER-SHAP-RF, uses the random forest for preliminary explanation of instances and determining a feature probability distribution which is applied to selection of features in the ensemble-based procedure of ER-SHAP. Many numerical experiments illustrating the proposed modifications demonstrate their efficiency and properties for local explanation.
References in corpus (14)
- Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Survey
- InterpretML: A Unified Framework for Machine Learning Interpretability
- Explaining by Removing: A Unified Framework for Model Explanation
- On Explainability of Graph Neural Networks via Subgraph Explorations
- Explaining Anomalies Detected by Autoencoders Using SHAP
- Explaining the Explainer: A First Theoretical Analysis of LIME
- Explaining Deep Neural Networks with a Polynomial Time Algorithm for Shapley Values Approximation
- A Survey on Neural Network Interpretability
- Generalized SHAP: Generating multiple types of explanations in machine learning
- Shapley explainability on the data manifold
- X-SHAP: towards multiplicative explainability of Machine Learning
- Shapley Values of Reconstruction Errors of PCA for Explaining Anomaly Detection
- Explainable Empirical Risk Minimization
- What does LIME really see in images?