Wasserstein-based fairness interpretability framework for machine learning models

Abstract

The objective of this article is to introduce a fairness interpretability framework for measuring and explaining the bias in classification and regression models at the level of a distribution. In our work, we measure the model bias across sub-population distributions in the model output using the Wasserstein metric. To properly quantify the contributions of predictors, we take into account the favorability of both the model and predictors with respect to the non-protected class. The quantification is accomplished by the use of transport theory, which gives rise to the decomposition of the model bias and bias explanations to positive and negative contributions. To gain more insight into the role of favorability and allow for additivity of bias explanations, we adapt techniques from cooperative game theory.

arXiv comment39 pages. (submitted for publication)

References in corpus (15)

• Equality of Opportunity in Supervised Learning
• Consistent Individualized Feature Attribution for Tree Ensembles
• A consistent multivariate test of association based on ranks of distances
• Learning Non-Discriminatory Predictors
• Feature relevance quantification in explainable AI: A causal problem
• Fairness Under Unawareness: Assessing Disparity When Protected Class Is Unobserved
• Identifying and Correcting Label Bias in Machine Learning
• Measuring dependence powerfully and equitably
• Consistent distribution-free $K$-sample and independence tests for univariate random variables
• True to the Model or True to the Data?
• On the Art and Science of Machine Learning Explanations
• On approximate validation of models: A Kolmogorov-Smirnov based approach
• An Empirical Study of Leading Measures of Dependence
• $(f,\Gamma )$-Divergences: Interpolating between $f$-Divergences and Integral Probability Metrics
• Stability theory of game-theoretic group feature explanations for machine learning models

Cited by in corpus (4)

• FairCanary: Rapid Continuous Explainable Fairness
• Optimal Transport for Efficient, Unsupervised Anomaly Detection on Industrial Data
• Unified Shapley Framework to Explain Prediction Drift
• Model-agnostic bias mitigation methods with regressor distribution control for Wasserstein-based fairness metrics