708 citations · 1k across the 22 of their papers we have counts for
4 papers · 1 filter
Empirical Methodology for Crowdsourcing Ground Truth
Anca Dumitrache, Oana Inel, Benjamin Timmermans +4
The process of gathering ground truth data through human annotation is a major bottleneck in the use of information extraction methods for populating the Semantic Web. Crowdsourcin…
Crowdsourcing Semantic Label Propagation in Relation Classification
Anca Dumitrache, Lora Aroyo, Chris Welty
Distant supervision is a popular method for performing relation extraction from text that is known to produce noisy labels. Most progress in relation extraction and classification…
CrowdTruth 2.0: Quality Metrics for Crowdsourcing with Disagreement
Anca Dumitrache, Oana Inel, Lora Aroyo +2
Typically crowdsourcing-based approaches to gather annotated data use inter-annotator agreement as a measure of quality. However, in many domains, there is ambiguity in the data, a…
Capturing Ambiguity in Crowdsourcing Frame Disambiguation
Anca Dumitrache, Lora Aroyo, Chris Welty
FrameNet is a computational linguistics resource composed of semantic frames, high-level concepts that represent the meanings of words. In this paper, we present an approach to gat…