44 citations · 223 across the 40 of their papers we have counts for
5 papers · 1 filter
How Crowd Worker Factors Influence Subjective Annotations: A Study of Tagging Misogynistic Hate Speech in Tweets
Danula Hettiachchi, Indigo Holcombe-James, Stephanie Livingstone +4
Crowdsourced annotation is vital to both collecting labelled data to train and test automated content moderation systems and to support human-in-the-loop review of system decisions…
Designing Closed-Loop Models for Task Allocation
Vijay Keswani, L. Elisa Celis, Krishnaram Kenthapadi +1
Automatically assigning tasks to people is challenging because human performance can vary across tasks for many reasons. This challenge is further compounded in real-life settings…
Same Same, But Different: Conditional Multi-Task Learning for Demographic-Specific Toxicity Detection
Soumyajit Gupta, Sooyong Lee, Maria De-Arteaga +1
Algorithmic bias often arises as a result of differential subgroup validity, in which predictive relationships vary across groups. For example, in toxic language detection, comment…
Learning Complementary Policies for Human-AI Teams
Ruijiang Gao, Maytal Saar-Tsechansky, Maria De-Arteaga
This paper tackles the critical challenge of human-AI complementarity in decision-making. Departing from the traditional focus on algorithmic performance in favor of performance of…
New Metrics to Encourage Innovation and Diversity in Information Retrieval Approaches
Mehmet Deniz Türkmen, Matthew Lease, Mucahid Kutlu
In evaluation campaigns, participants often explore variations of popular, state-of-the-art baselines as a low-risk strategy to achieve competitive results. While effective, this c…