activity
20172021
most citedBeyond opening up the black box: Investigating the role of algorithmic systems in Wikipedian organizational culture

89 citations · 173 across the 4 of their papers we have counts for

collaborators

8 papers

cs.LG202174 cited

"Garbage In, Garbage Out" Revisited: What Do Machine Learning Application Papers Report About Human-Labeled Training Data?

R. Stuart Geiger, Dominique Cope, Jamie Ip +4

Supervised machine learning, in which models are automatically derived from labeled training data, is only as good as the quality of that data. This study builds on prior work that…

cs.CY2019

Garbage In, Garbage Out? Do Machine Learning Application Papers in Social Computing Report Where Human-Labeled Training Data Comes From?

R. Stuart Geiger, Kevin Yu, Yanlai Yang +4

Many machine learning projects for new application areas involve teams of humans who label data for a particular purpose, from hiring crowdworkers to the paper's authors labeling t…

cs.HC2019

The Rise and Fall of the Note: Changing Paper Lengths in ACM CSCW, 2000-2018

R. Stuart Geiger

In this note, I quantitatively examine various trends in the lengths of published papers in ACM CSCW from 2000-2018, focusing on several major transitions in editorial and reviewin…

cs.HC2019

ORES: Lowering Barriers with Participatory Machine Learning in Wikipedia

Aaron Halfaker, R. Stuart Geiger

Algorithmic systems---from rule-based bots to machine learning classifiers---have a long history of supporting the essential work of content moderation and other curation work in p…

cs.CY2018

Operationalizing Conflict and Cooperation between Automated Software Agents in Wikipedia: A Replication and Expansion of 'Even Good Bots Fight'

R. Stuart Geiger, Aaron Halfaker

This paper replicates, extends, and refutes conclusions made in a study published in PLoS ONE ("Even Good Bots Fight"), which claimed to identify substantial levels of conflict bet…

cs.CY2018

The Types, Roles, and Practices of Documentation in Data Analytics Open Source Software Libraries: A Collaborative Ethnography of Documentation Work

R. Stuart Geiger, Nelle Varoquaux, Charlotte Mazel-Cabasse +1

Computational research and data analytics increasingly relies on complex ecosystems of open source software (OSS) "libraries" -- curated collections of reusable code that programme…