ORES: Lowering Barriers with Participatory Machine Learning in Wikipedia

Abstract

Algorithmic systems---from rule-based bots to machine learning classifiers---have a long history of supporting the essential work of content moderation and other curation work in peer production projects. From counter-vandalism to task routing, basic machine prediction has allowed open knowledge projects like Wikipedia to scale to the largest encyclopedia in the world, while maintaining quality and consistency. However, conversations about how quality control should work and what role algorithms should play have generally been led by the expert engineers who have the skills and resources to develop and modify these complex algorithmic systems. In this paper, we describe ORES: an algorithmic scoring service that supports real-time scoring of wiki edits using multiple independent classifiers trained on different datasets. ORES decouples several activities that have typically all been performed by engineers: choosing or curating training data, building models to serve predictions, auditing predictions, and developing interfaces or automated agents that act on those predictions. This meta-algorithmic system was designed to open up socio-technical conversations about algorithms in Wikipedia to a broader set of participants. In this paper, we discuss the theoretical mechanisms of social change ORES enables and detail case studies in participatory machine learning around ORES from the 5 years since its deployment.

arXiv comment29 pages + 3 pages appendix. Currently under review

References in corpus (3)

• Beyond opening up the black box: Investigating the role of algorithmic systems in Wikipedian organizational culture
• Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems
• Fairness in Criminal Justice Risk Assessments: The State of the Art

Cited by in corpus (9)

• Power to the People? Opportunities and Challenges for Participatory AI
• Understanding Frontline Workers' and Unhoused Individuals' Perspectives on AI Used in Homeless Services
• Data Governance in the Age of Large-Scale Data-Driven Language Technology
• CASS: Towards Building a Social-Support Chatbot for Online Health Community
• A Large-Scale Characterization of How Readers Browse Wikipedia
• Is Machine Learning Speaking my Language? A Critical Look at the NLP-Pipeline Across 8 Human Languages
• Increasing Participation in Peer Production Communities with the Newcomer Homepage
• Orphan Articles: The Dark Matter of Wikipedia
• Identifying Terms and Conditions Important to Consumers using Crowdsourcing