Inclusive Portraits: Race-Aware Human-in-the-Loop Technology
arXiv:2311.03567 · doi:10.1145/3617694.3623235
Abstract
AI has revolutionized the processing of various services, including the automatic facial verification of people. Automated approaches have demonstrated their speed and efficiency in verifying a large volume of faces, but they can face challenges when processing content from certain communities, including communities of people of color. This challenge has prompted the adoption of "human-in-the-loop" (HITL) approaches, where human workers collaborate with the AI to minimize errors. However, most HITL approaches do not consider workers' individual characteristics and backgrounds. This paper proposes a new approach, called Inclusive Portraits (IP), that connects with social theories around race to design a racially-aware human-in-the-loop system. Our experiments have provided evidence that incorporating race into human-in-the-loop (HITL) systems for facial verification can significantly enhance performance, especially for services delivered to people of color. Our findings also highlight the importance of considering individual worker characteristics in the design of HITL systems, rather than treating workers as a homogenous group. Our research has significant design implications for developing AI-enhanced services that are more inclusive and equitable.
References in corpus (6)
- Deep Face Recognition: A Survey
- Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Development
- Jury Learning: Integrating Dissenting Voices into Machine Learning Models
- Recent Advances in Deep Learning Techniques for Face Recognition
- Crowd Coach: Peer Coaching for Crowd Workers' Skill Growth
- Fighting Disaster Misinformation in Latin America: The #19S Mexican Earthquake Case Study