activity
20172020
most citedCrowdsourcing Ground Truth for Medical Relation Extraction

63 citations · 146 across the 8 of their papers we have counts for

collaborators

8 papers

cs.IR2020★ 27 cited

Beyond Optimizing for Clicks: Incorporating Editorial Values in News Recommendation

Feng Lu, Anca Dumitrache, David Graus

With the uptake of algorithmic personalization in the news domain, news organizations increasingly trust automated systems with previously considered editorial responsibilities, e.…

cs.CL2019★ 19 cited

A Crowdsourced Frame Disambiguation Corpus with Ambiguity

Anca Dumitrache, Lora Aroyo, Chris Welty

We present a resource for the task of FrameNet semantic frame disambiguation of over 5,000 word-sentence pairs from the Wikipedia corpus. The annotations were collected using a nov…

cs.HC2018★ 8 cited

Empirical Methodology for Crowdsourcing Ground Truth

Anca Dumitrache, Oana Inel, Benjamin Timmermans +4

The process of gathering ground truth data through human annotation is a major bottleneck in the use of information extraction methods for populating the Semantic Web. Crowdsourcin…

cs.CL2018★ 8 cited

Crowdsourcing Semantic Label Propagation in Relation Classification

Anca Dumitrache, Lora Aroyo, Chris Welty

Distant supervision is a popular method for performing relation extraction from text that is known to produce noisy labels. Most progress in relation extraction and classification…

cs.HC2018★ 8 cited

CrowdTruth 2.0: Quality Metrics for Crowdsourcing with Disagreement

Anca Dumitrache, Oana Inel, Lora Aroyo +2

Typically crowdsourcing-based approaches to gather annotated data use inter-annotator agreement as a measure of quality. However, in many domains, there is ambiguity in the data, a…

cs.CL2018★ 12 cited

Capturing Ambiguity in Crowdsourcing Frame Disambiguation

Anca Dumitrache, Lora Aroyo, Chris Welty

FrameNet is a computational linguistics resource composed of semantic frames, high-level concepts that represent the meanings of words. In this paper, we present an approach to gat…

cs.CL2017★ 1 cited

False Positive and Cross-relation Signals in Distant Supervision Data

Anca Dumitrache, Lora Aroyo, Chris Welty

Distant supervision (DS) is a well-established method for relation extraction from text, based on the assumption that when a knowledge-base contains a relation between a term pair,…

cs.CL2017★ 63 cited

Crowdsourcing Ground Truth for Medical Relation Extraction

Anca Dumitrache, Lora Aroyo, Chris Welty

Cognitive computing systems require human labeled data for evaluation, and often for training. The standard practice used in gathering this data minimizes disagreement between anno…