164 citations · 288 across the 13 of their papers we have counts for
Showing 2021Show all
2 papers · 1 filter
cs.LG2021★ 24 cited
Whose Ground Truth? Accounting for Individual and Collective Identities Underlying Dataset Annotation
Remi Denton, Mark Díaz, Ian Kivlichan +2
Human annotations play a crucial role in machine learning (ML) research and development. However, the ethical considerations around the processes and decisions that go into buildin…
cs.LG2021★ 2 cited
Measuring and Improving Model-Moderator Collaboration using Uncertainty Estimation
Ian D. Kivlichan, Zi Lin, Jeremiah Liu +1
Content moderation is often performed by a collaboration between humans and machine learning models. However, it is not well understood how to design the collaborative process so a…