Wikibench: Community-Driven Data Curation for AI Evaluation on Wikipedia

Abstract

AI tools are increasingly deployed in community contexts. However, datasets used to evaluate AI are typically created by developers and annotators outside a given community, which can yield misleading conclusions about AI performance. How might we empower communities to drive the intentional design and curation of evaluation datasets for AI that impacts them? We investigate this question on Wikipedia, an online community with multiple AI-based content moderation tools deployed. We introduce Wikibench, a system that enables communities to collaboratively curate AI evaluation datasets, while navigating ambiguities and differences in perspective through discussion. A field study on Wikipedia shows that datasets curated using Wikibench can effectively capture community consensus, disagreement, and uncertainty. Furthermore, study participants used Wikibench to shape the overall data curation process, including refining label definitions, determining data inclusion criteria, and authoring data statements. Based on our findings, we propose future directions for systems that support community-driven data curation.

References in corpus (15)

• Lessons from Archives: Strategies for Collecting Sociocultural Data in Machine Learning
• Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors
• Jury Learning: Integrating Dissenting Voices into Machine Learning Models
• Fine-tuning language models to find agreement among humans with diverse preferences
• Understanding Frontline Workers' and Unhoused Individuals' Perspectives on AI Used in Homeless Services
• Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems
• Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice
• Deliberating with AI: Improving Decision-Making for the Future through Participatory AI Design and Stakeholder Deliberation
• Toward a Perspectivist Turn in Ground Truthing for Predictive Computing
• Discovering and Validating AI Errors With Crowdsourced Failure Reports
• Image Cropping on Twitter: Fairness Metrics, their Limitations, and the Importance of Representation, Design, and Agency
• Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehension
• Operationalizing Conflict and Cooperation between Automated Software Agents in Wikipedia: A Replication and Expansion of 'Even Good Bots Fight'
• Upvotes? Downvotes? No Votes? Understanding the relationship between reaction mechanisms and political discourse on Reddit
• Cura: Curation at Social Media Scale

Cited by in corpus (4)

• PolicyCraft: Supporting Collaborative and Participatory Policy Design through Case-Grounded Deliberation
• Secondary Stakeholders in AI: Fighting for, Brokering, and Navigating Agency
• Wisdom of the Crowd, Without the Crowd: A Socratic LLM for Asynchronous Deliberation on Perspectivist Data
• Policy Maps: Tools for Guiding the Unbounded Space of LLM Behaviors