Exposing the Probabilistic Causal Structure of Discrimination

Abstract

Discrimination discovery from data is an important task aiming at identifying patterns of illegal and unethical discriminatory activities against protected-by-law groups, e.g., ethnic minorities. While any legally-valid proof of discrimination requires evidence of causality, the state-of-the-art methods are essentially correlation-based, albeit, as it is well known, correlation does not imply causation. In this paper we take a principled causal approach to the data mining problem of discrimination detection in databases. Following Suppes' probabilistic causation theory, we define a method to extract, from a dataset of historical decision records, the causal structures existing among the attributes in the data. The result is a type of constrained Bayesian network, which we dub Suppes-Bayes Causal Network (SBCN). Next, we develop a toolkit of methods based on random walks on top of the SBCN, addressing different anti-discrimination legal concepts, such as direct and indirect discrimination, group and individual discrimination, genuine requirement, and favoritism. Our experiments on real-world datasets confirm the inferential power of our approach in all these different tasks.

References in corpus (1)

• CAPRI: Efficient Inference of Cancer Progression Models from Cross-sectional Data

Cited by in corpus (20)

• FA*IR: A Fair Top-k Ranking Algorithm
• The Measure and Mismeasure of Fairness
• Avoiding Discrimination through Causal Reasoning
• Fairness in Algorithmic Decision Making: An Excursion Through the Lens of Causality
• Human Perceptions of Fairness in Algorithmic Decision Making: A Case Study of Criminal Risk Prediction
• Open the Black Box Data-Driven Explanation of Black Box Decision Systems
• Some models are useful, but how do we know which ones? Towards a unified Bayesian model taxonomy
• Causal Data Science for Financial Stress Testing
• Understanding Agent Incentives using Causal Influence Diagrams. Part I: Single Action Settings
• A causal framework for discovering and removing direct and indirect discrimination
• Modeling cumulative biological phenomena with Suppes-Bayes Causal Networks
• On Discrimination Discovery and Removal in Ranked Data using Causal Graph
• Correspondences between Privacy and Nondiscrimination: Why They Should Be Studied Together
• A Model of Selective Advantage for the Efficient Inference of Cancer Clonal Evolution
• Observing and Recommending from a Social Web with Biases
• Achieving non-discrimination in data release
• Beyond traditional assumptions in fair machine learning
• Shortcomings of Counterfactual Fairness and a Proposed Modification
• Probabilistic Causal Analysis of Social Influence
• Investigating the performance of multi-objective optimization when learning Bayesian Networks