28 citations · 56 across the 5 of their papers we have counts for
Showing 2018Show all
2 papers · 1 filter
cs.HC2018★ 8 cited
Empirical Methodology for Crowdsourcing Ground Truth
Anca Dumitrache, Oana Inel, Benjamin Timmermans +4
The process of gathering ground truth data through human annotation is a major bottleneck in the use of information extraction methods for populating the Semantic Web. Crowdsourcin…
cs.HC2018★ 8 cited
CrowdTruth 2.0: Quality Metrics for Crowdsourcing with Disagreement
Anca Dumitrache, Oana Inel, Lora Aroyo +2
Typically crowdsourcing-based approaches to gather annotated data use inter-annotator agreement as a measure of quality. However, in many domains, there is ambiguity in the data, a…