Fair Machine Guidance to Enhance Fair Decision Making in Biased People

Abstract

Teaching unbiased decision-making is crucial for addressing biased decision-making in daily life. Although both raising awareness of personal biases and providing guidance on unbiased decision-making are essential, the latter topics remains under-researched. In this study, we developed and evaluated an AI system aimed at educating individuals on making unbiased decisions using fairness-aware machine learning. In a between-subjects experimental design, 99 participants who were prone to bias performed personal assessment tasks. They were divided into two groups: a) those who received AI guidance for fair decision-making before the task and b) those who received no such guidance but were informed of their biases. The results suggest that although several participants doubted the fairness of the AI system, fair machine guidance prompted them to reassess their views regarding fairness, reflect on their biases, and modify their decision-making criteria. Our findings provide insights into the design of AI systems for guiding fair decision-making in humans.

18 pages, 8 figures, proceeding of ACM CHI 2024

References in corpus (8)

• Equality of Opportunity in Supervised Learning
• A Case for Humans-in-the-Loop: Decisions in the Presence of Erroneous Algorithmic Scores
• Do People Engage Cognitively with AI? Impact of AI Assistance on Incidental Learning
• Knowing About Knowing: An Illusion of Human Competence Can Hinder Appropriate Reliance on AI Systems
• Human Perceptions on Moral Responsibility of AI: A Case Study in AI-Assisted Bail Decision-Making
• Soliciting Stakeholders' Fairness Notions in Child Maltreatment Predictive Systems
• "If I Had All the Time in the World": Ophthalmologists' Perceptions of Anchoring Bias Mitigation in Clinical AI Support
• CrowDEA: Multi-view Idea Prioritization with Crowds