Counterfactual Shapley Additive Explanations

Abstract

Feature attributions are a common paradigm for model explanations due to their simplicity in assigning a single numeric score for each input feature to a model. In the actionable recourse setting, wherein the goal of the explanations is to improve outcomes for model consumers, it is often unclear how feature attributions should be correctly used. With this work, we aim to strengthen and clarify the link between actionable recourse and feature attributions. Concretely, we propose a variant of SHAP, Counterfactual SHAP (CF-SHAP), that incorporates counterfactual information to produce a background dataset for use within the marginal (a.k.a. interventional) Shapley value framework. We motivate the need within the actionable recourse setting for careful consideration of background datasets when using Shapley values for feature attributions with numerous synthetic examples. Moreover, we demonstrate the efficacy of CF-SHAP by proposing and justifying a quantitative score for feature attributions, counterfactual-ability, showing that as measured by this metric, CF-SHAP is superior to existing methods when evaluated on public datasets using tree ensembles.

Accepted at FAccT '22 (2022 ACM Conference on Fairness, Accountability, and Transparency)

References in corpus (26)

• XGBoost: A Scalable Tree Boosting System
• Explaining Machine Learning Classifiers through Diverse Counterfactual Explanations
• Actionable Recourse in Linear Classification
• FACE: Feasible and Actionable Counterfactual Explanations
• The Hidden Assumptions Behind Counterfactual Explanations and Principal Reasons
• Local Rule-Based Explanations of Black Box Decision Systems
• CERTIFAI: Counterfactual Explanations for Robustness, Transparency, Interpretability, and Fairness of Artificial Intelligence models
• Multi-Objective Counterfactual Explanations
• Learning Model-Agnostic Counterfactual Explanations for Tabular Data
• Feature relevance quantification in explainable AI: A causal problem
• Model Agnostic Supervised Local Explanations
• Problems with Shapley-value-based explanations as feature importance measures
• Counterfactual Explanation Algorithms for Behavioral and Textual Data
• Towards Unifying Feature Attribution and Counterfactual Explanations: Different Means to the Same End
• Algorithmic recourse under imperfect causal knowledge: a probabilistic approach
• Algorithmic Recourse: from Counterfactual Explanations to Interventions
• Generating Counterfactual and Contrastive Explanations using SHAP
• Explaining Data-Driven Decisions made by AI Systems: The Counterfactual Approach
• Measurable Counterfactual Local Explanations for Any Classifier
• True to the Model or True to the Data?
• PermuteAttack: Counterfactual Explanation of Machine Learning Credit Scorecards
• Shapley Flow: A Graph-based Approach to Interpreting Model Predictions
• Beyond Individualized Recourse: Interpretable and Interactive Summaries of Actionable Recourses
• Rational Shapley Values
• Counterfactual Explanations for Arbitrary Regression Models
• Generalized Integrated Gradients: A practical method for explaining diverse ensembles

Cited by in corpus (1)

• On the Connection between Game-Theoretic Feature Attributions and Counterfactual Explanations