Fairness in Ranking: A Survey

Abstract

In the past few years, there has been much work on incorporating fairness requirements into algorithmic rankers, with contributions coming from the data management, algorithms, information retrieval, and recommender systems communities. In this survey we give a systematic overview of this work, offering a broad perspective that connects formalizations and algorithmic approaches across subfields. An important contribution of our work is in developing a common narrative around the value frameworks that motivate specific fairness-enhancing interventions in ranking. This allows us to unify the presentation of mitigation objectives and of algorithmic techniques to help meet those objectives or identify trade-offs. In this survey, we describe four classification frameworks for fairness-enhancing interventions, along which we relate the technical methods surveyed in this paper, discuss evaluation datasets, and present technical work on fairness in score-based ranking. Then, we present methods that incorporate fairness in supervised learning, and also give representative examples of recent work on fairness in recommendation and matchmaking systems. We also discuss evaluation frameworks for fair score-based ranking and fair learning-to-rank, and draw a set of recommendations for the evaluation of fair ranking methods.

72 pages. ACM CSUR (2022)

References in corpus (3)

• Fairness in Machine Learning
• On the (im)possibility of fairness
• Policy Learning for Fairness in Ranking

Cited by in corpus (13)

• Fairness in Recommender Systems: Research Landscape and Future Directions
• Building Human Values into Recommender Systems: An Interdisciplinary Synthesis
• Fairness and Bias in Algorithmic Hiring: a Multidisciplinary Survey
• Economic Recommender Systems -- A Systematic Review
• Recommending With, Not For: Co-Designing Recommender Systems for Social Good
• Predictive Uncertainty-based Bias Mitigation in Ranking
• Properties of Group Fairness Metrics for Rankings
• Control Search Rankings, Control the World: What is a Good Search Engine?
• Fairness Rising from the Ranks: HITS and PageRank on Homophilic Networks
• Maximizing Neutrality in News Ordering
• ShaRP: Explaining Rankings and Preferences with Shapley Values
• hyperFA*IR: A hypergeometric approach to fair rankings with finite candidate pool
• Searching Personal Collections