20 citations · 25 across the 3 of their papers we have counts for
Showing 2018 · cs.HCShow all
2 papers · 2 filters
cs.HC2018
Empirical Methodology for Crowdsourcing Ground Truth
Anca Dumitrache, Oana Inel, Benjamin Timmermans +4
The process of gathering ground truth data through human annotation is a major bottleneck in the use of information extraction methods for populating the Semantic Web. Crowdsourcin…
cs.HC2018
CrowdTruth 2.0: Quality Metrics for Crowdsourcing with Disagreement
Anca Dumitrache, Oana Inel, Lora Aroyo +2
Typically crowdsourcing-based approaches to gather annotated data use inter-annotator agreement as a measure of quality. However, in many domains, there is ambiguity in the data, a…