What will it take to generate fairness-preserving explanations?
arXiv:2106.13346
Abstract
In situations where explanations of black-box models may be useful, the fairness of the black-box is also often a relevant concern. However, the link between the fairness of the black-box model and the behavior of explanations for the black-box is unclear. We focus on explanations applied to tabular datasets, suggesting that explanations do not necessarily preserve the fairness properties of the black-box algorithm. In other words, explanation algorithms can ignore or obscure critical relevant properties, creating incorrect or misleading explanations. More broadly, we propose future research directions for evaluating and generating explanations such that they are informative and relevant from a fairness perspective.
arXiv commentPresented at ICML 2021 Workshop on Theoretic Foundation, Criticism, and Application Trend of Explainable AI
References in corpus (5)
- Equality of Opportunity in Supervised Learning
- The Measure and Mismeasure of Fairness
- "Why Should You Trust My Explanation?" Understanding Uncertainty in LIME Explanations
- Machine Learning Explainability for External Stakeholders
- Epistemic values in feature importance methods: Lessons from feminist epistemology