From Fitting Participation to Forging Relationships: The Art of Participatory ML

Abstract

Participatory machine learning (ML) encourages the inclusion of end users and people affected by ML systems in design and development processes. We interviewed 18 participation brokers -- individuals who facilitate such inclusion and transform the products of participants' labour into inputs for an ML artefact or system -- across a range of organisational settings and project locations. Our findings demonstrate the inherent challenges of integrating messy contextual information generated through participation with the structured data formats required by ML workflows and the uneven power dynamics in project contexts. We advocate for evolution in the role of brokers to more equitably balance value generated in Participatory ML projects for design and development teams with value created for participants. To move beyond `fitting' participation to existing processes and empower participants to envision alternative futures through ML, brokers must become educators and advocates for end users, while attending to frustration and dissent from indirect stakeholders.

To appear in Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI '24)

References in corpus (8)

• Decolonial AI: Decolonial Theory as Sociotechnical Foresight in Artificial Intelligence
• Accountability in an Algorithmic Society: Relationality, Responsibility, and Robustness in Machine Learning
• Envisioning Communities: A Participatory Approach Towards AI for Social Good
• A Systematic Review and Thematic Analysis of Community-Collaborative Approaches to Computing Research
• Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice
• Deliberating with AI: Improving Decision-Making for the Future through Participatory AI Design and Stakeholder Deliberation
• Queer In AI: A Case Study in Community-Led Participatory AI
• Contestable Camera Cars: A Speculative Design Exploration of Public AI That Is Open and Responsive to Dispute

Cited by in corpus (4)

• The Value-Sensitive Conversational Agent Co-Design Framework
• Secondary Stakeholders in AI: Fighting for, Brokering, and Navigating Agency
• Recommending With, Not For: Co-Designing Recommender Systems for Social Good
• Abstraction Alignment: Comparing Model-Learned and Human-Encoded Conceptual Relationships