Mapping Stakeholder Needs to Multi-Sided Fairness in Candidate Recommendation for Algorithmic Hiring

Abstract

Already before the enactment of the EU AI Act, candidate or job recommendation for algorithmic hiring -- semi-automatically matching CVs to job postings -- was used as an example of a high-risk application where unfair treatment could result in serious harms to job seekers. Recommending candidates to jobs or jobs to candidates, however, is also a fitting example of a multi-stakeholder recommendation problem. In such multi-stakeholder systems, the end user is not the only party whose interests should be considered when generating recommendations. In addition to job seekers, other stakeholders -- such as recruiters, organizations behind the job postings, and the recruitment agency itself -- are also stakeholders in this and deserve to have their perspectives included in the design of relevant fairness metrics. Nevertheless, past analyses of fairness in algorithmic hiring have been restricted to single-side fairness, ignoring the perspectives of the other stakeholders. In this paper, we address this gap and present a multi-stakeholder approach to fairness in a candidate recommender system that recommends relevant candidate CVs to human recruiters in a human-in-the-loop algorithmic hiring scenario. We conducted semi-structured interviews with 40 different stakeholders (job seekers, companies, recruiters, and other job portal employees). We used these interviews to explore their lived experiences of unfairness in hiring, co-design definitions of fairness as well as metrics that might capture these experiences. Finally, we attempt to reconcile and map these different (and sometimes conflicting) perspectives and definitions to existing (categories of) fairness metrics that are relevant for our candidate recommendation scenario.

References in corpus (16)

• Mitigating Bias in Algorithmic Hiring: Evaluating Claims and Practices
• Improving fairness in machine learning systems: What do industry practitioners need?
• Fairness in Machine Learning: A Survey
• FA*IR: A Fair Top-k Ranking Algorithm
• A Survey on the Fairness of Recommender Systems
• Fairness-Aware Ranking in Search & Recommendation Systems with Application to LinkedIn Talent Search
• Beyond Personalization: Research Directions in Multistakeholder Recommendation
• Measurement and Fairness
• A Clarification of the Nuances in the Fairness Metrics Landscape
• Fairness in Recommender Systems: Research Landscape and Future Directions
• Fairness in Information Access Systems
• Building Human Values into Recommender Systems: An Interdisciplinary Synthesis
• Fairness and Bias in Algorithmic Hiring: a Multidisciplinary Survey
• Fairness and Transparency in Recommendation: The Users' Perspective
• A Graph-based Approach for Mitigating Multi-sided Exposure Bias in Recommender Systems
• Evaluation Measures of Individual Item Fairness for Recommender Systems: A Critical Study