50 Years of Test (Un)fairness: Lessons for Machine Learning

Abstract

Quantitative definitions of what is unfair and what is fair have been introduced in multiple disciplines for well over 50 years, including in education, hiring, and machine learning. We trace how the notion of fairness has been defined within the testing communities of education and hiring over the past half century, exploring the cultural and social context in which different fairness definitions have emerged. In some cases, earlier definitions of fairness are similar or identical to definitions of fairness in current machine learning research, and foreshadow current formal work. In other cases, insights into what fairness means and how to measure it have largely gone overlooked. We compare past and current notions of fairness along several dimensions, including the fairness criteria, the focus of the criteria (e.g., a test, a model, or its use), the relationship of fairness to individuals, groups, and subgroups, and the mathematical method for measuring fairness (e.g., classification, regression). This work points the way towards future research and measurement of (un)fairness that builds from our modern understanding of fairness while incorporating insights from the past.

arXiv commentFAT* '19: Conference on Fairness, Accountability, and Transparency (FAT* '19), January 29--31, 2019, Atlanta, GA, USA

References in corpus (9)

• Equality of Opportunity in Supervised Learning
• Counterfactual Fairness
• Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairness
• Fairness in Machine Learning
• Data Decisions and Theoretical Implications when Adversarially Learning Fair Representations
• Runaway Feedback Loops in Predictive Policing
• Satisfying Real-world Goals with Dataset Constraints
• From Parity to Preference-based Notions of Fairness in Classification
• InclusiveFaceNet: Improving Face Attribute Detection with Race and Gender Diversity

Cited by in corpus (29)

• Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices
• Prediction-Based Decisions and Fairness: A Catalogue of Choices, Assumptions, and Definitions
• Fairness in Machine Learning: A Survey
• Towards Fairer Datasets: Filtering and Balancing the Distribution of the People Subtree in the ImageNet Hierarchy
• Demographic Bias in Biometrics: A Survey on an Emerging Challenge
• An Empirical Characterization of Fair Machine Learning For Clinical Risk Prediction
• Rethinking Fairness: An Interdisciplinary Survey of Critiques of Hegemonic ML Fairness Approaches
• Fairness and Bias in Algorithmic Hiring: a Multidisciplinary Survey
• Comparing the Perceived Legitimacy of Content Moderation Processes: Contractors, Algorithms, Expert Panels, and Digital Juries
• A Stakeholder-Centered View on Fairness in Music Recommender Systems
• Ride-share matching algorithms generate income inequality
• Four Years of FAccT: A Reflexive, Mixed-Methods Analysis of Research Contributions, Shortcomings, and Future Prospects
• Fairness Score and Process Standardization: Framework for Fairness Certification in Artificial Intelligence Systems
• Awareness in Practice: Tensions in Access to Sensitive Attribute Data for Antidiscrimination
• Mitigating Unfairness via Evolutionary Multi-objective Ensemble Learning
• Evaluating Proposed Fairness Models for Face Recognition Algorithms
• Integrating Psychometrics and Computing Perspectives on Bias and Fairness in Affective Computing: A Case Study of Automated Video Interviews
• Equalizing Credit Opportunity in Algorithms: Aligning Algorithmic Fairness Research with U.S. Fair Lending Regulation
• Evaluation of group fairness measures in student performance prediction problems
• Reflexive Design for Fairness and Other Human Values in Formal Models
• BeFair: Addressing Fairness in the Banking Sector
• Respect as a Lens for the Design of AI Systems
• Hard Choices and Hard Limits for Artificial Intelligence
• On Prediction-Modelers and Decision-Makers: Why Fairness Requires More Than a Fair Prediction Model
• From the Fair Distribution of Predictions to the Fair Distribution of Social Goods: Evaluating the Impact of Fair Machine Learning on Long-Term Unemployment
• In-processing User Constrained Dominant Sets for User-Oriented Fairness in Recommender Systems
• Using Positive Matching Contrastive Loss with Facial Action Units to mitigate bias in Facial Expression Recognition
• Evaluating the Social Impact of Generative AI Systems in Systems and Society
• What is fair? Exploring the artists' perspective on the fairness of music streaming platforms