From the Fair Distribution of Predictions to the Fair Distribution of Social Goods: Evaluating the Impact of Fair Machine Learning on Long-Term Unemployment

Abstract

Deploying an algorithmically informed policy is a significant intervention in society. Prominent methods for algorithmic fairness focus on the distribution of predictions at the time of training, rather than the distribution of social goods that arises after deploying the algorithm in a specific social context. However, requiring a "fair" distribution of predictions may undermine efforts at establishing a fair distribution of social goods. First, we argue that addressing this problem requires a notion of prospective fairness that anticipates the change in the distribution of social goods after deployment. Second, we provide formal conditions under which this change is identified from pre-deployment data. That requires accounting for different kinds of performative effects. Here, we focus on the way predictions change policy decisions and, consequently, the causally downstream distribution of social goods. Throughout, we are guided by an application from public administration: the use of algorithms to predict who among the recently unemployed will remain unemployed in the long term and to target them with labor market programs. Third, using administrative data from the Swiss public employment service, we simulate how such algorithmically informed policies would affect gender inequalities in long-term unemployment. When risk predictions are required to be "fair" according to statistical parity and equality of opportunity, targeting decisions are less effective, undermining efforts to both lower overall levels of long-term unemployment and to close the gender gap in long-term unemployment.

41 pages, 12 figures, 6 tables; substantial text overlap with arXiv:2310.08349

References in corpus (11)

• Inherent Trade-Offs in the Fair Determination of Risk Scores
• Algorithms and Decision-Making in the Public Sector
• Escaping the Impossibility of Fairness: From Formal to Substantive Algorithmic Fairness
• A Classification of Feedback Loops and Their Relation to Biases in Automated Decision-Making Systems
• Algorithmic Unfairness through the Lens of EU Non-Discrimination Law: Or Why the Law is not a Decision Tree
• Target specification bias, counterfactual prediction, and algorithmic fairness in healthcare
• Fairness in Algorithmic Profiling: A German Case Study
• Modelling the long-term fairness dynamics of data-driven targeted help on job seekers
• On the Richness of Calibration
• Fair When Trained, Unfair When Deployed: Observable Fairness Measures are Unstable in Performative Prediction Settings
• Correcting Underrepresentation and Intersectional Bias for Classification

Cited by in corpus (2)

• Reconsidering Fairness Through Unawareness From the Perspective of Model Multiplicity
• Toward Substantive Intersectional Algorithmic Fairness: Desiderata for a Feminist Approach