Keeping Community in the Loop: Understanding Wikipedia Stakeholder Values for Machine Learning-Based Systems

Abstract

On Wikipedia, sophisticated algorithmic tools are used to assess the quality of edits and take corrective actions. However, algorithms can fail to solve the problems they were designed for if they conflict with the values of communities who use them. In this study, we take a Value-Sensitive Algorithm Design approach to understanding a community-created and -maintained machine learning-based algorithm called the Objective Revision Evaluation System (ORES)---a quality prediction system used in numerous Wikipedia applications and contexts. Five major values converged across stakeholder groups that ORES (and its dependent applications) should: (1) reduce the effort of community maintenance, (2) maintain human judgement as the final authority, (3) support differing peoples' differing workflows, (4) encourage positive engagement with diverse editor groups, and (5) establish trustworthiness of people and algorithms within the community. We reveal tensions between these values and discuss implications for future research to improve algorithms like ORES.

10 pages, 1 table, accepted paper to CHI 2020 conference

References in corpus (10)

• Towards A Rigorous Science of Interpretable Machine Learning
• Equality of Opportunity in Supervised Learning
• Understanding Black-box Predictions via Influence Functions
• Model-Agnostic Interpretability of Machine Learning
• Fairness and Accountability Design Needs for Algorithmic Support in High-Stakes Public Sector Decision-Making
• On Fairness and Calibration
• The Frontiers of Fairness in Machine Learning
• Beyond opening up the black box: Investigating the role of algorithmic systems in Wikipedian organizational culture
• Surviving an "Eternal September" - How an Online Community Managed a Surge of Newcomers
• Operationalizing Conflict and Cooperation between Automated Software Agents in Wikipedia: A Replication and Expansion of 'Even Good Bots Fight'

Cited by in corpus (22)

• On the Opportunities and Risks of Foundation Models
• Jury Learning: Integrating Dissenting Voices into Machine Learning Models
• Imagining new futures beyond predictive systems in child welfare: A qualitative study with impacted stakeholders
• Deliberating with AI: Improving Decision-Making for the Future through Participatory AI Design and Stakeholder Deliberation
• Modeling Assumptions Clash with the Real World: Transparency, Equity, and Community Challenges for Student Assignment Algorithms
• `It is currently hodgepodge'': Examining AI/ML Practitioners' Challenges during Co-production of Responsible AI Values
• Epistemic values in feature importance methods: Lessons from feminist epistemology
• RECAST: Enabling User Recourse and Interpretability of Toxicity Detection Models with Interactive Visualization
• ORES: Lowering Barriers with Participatory Machine Learning in Wikipedia
• Wikibench: Community-Driven Data Curation for AI Evaluation on Wikipedia
• Disseminating Research News in HCI: Perceived Hazards, How-To's, and Opportunities for Innovation
• Summaries, Highlights, and Action items: Design, implementation and evaluation of an LLM-powered meeting recap system
• PolicyCraft: Supporting Collaborative and Participatory Policy Design through Case-Grounded Deliberation
• Cura: Curation at Social Media Scale
• Nip it in the Bud: Moderation Strategies in Open Source Software Projects and the Role of Bots
• Secondary Stakeholders in AI: Fighting for, Brokering, and Navigating Agency
• Observe, Ask, Intervene: Designing AI Agents for More Inclusive Meetings
• Supporting Industry Computing Researchers in Assessing, Articulating, and Addressing the Potential Negative Societal Impact of Their Work
• "Ohhh, He's the Boss!": Unpacking Power Dynamics Among Developers, Designers, and End-Users in FLOSS Usability
• WikiCheck: An end-to-end open source Automatic Fact-Checking API based on Wikipedia
• Anchor Prediction: A Topic Modeling Approach
• The Medical Authority of AI: A Study of AI-enabled Consumer-facing Health Technology