27 citations · 28 across the 2 of their papers we have counts for
Showing cs.HCShow all
2 papers · 1 filter
cs.HC2018
Empirical Methodology for Crowdsourcing Ground Truth
Anca Dumitrache, Oana Inel, Benjamin Timmermans +4
The process of gathering ground truth data through human annotation is a major bottleneck in the use of information extraction methods for populating the Semantic Web. Crowdsourcin…
cs.HC2018
CrowdTruth 2.0: Quality Metrics for Crowdsourcing with Disagreement
Anca Dumitrache, Oana Inel, Lora Aroyo +2
Typically crowdsourcing-based approaches to gather annotated data use inter-annotator agreement as a measure of quality. However, in many domains, there is ambiguity in the data, a…