most citedIn Search of Ambiguity: A Three-Stage Workflow Design to Clarify Annotation Guidelines for Crowd Workers

1 citations · 1 across the 1 of their papers we have counts for

collaborators

1 paper

cs.HC2021★ 1 cited

In Search of Ambiguity: A Three-Stage Workflow Design to Clarify Annotation Guidelines for Crowd Workers

Vivek Krishna Pradhan, Mike Schaekermann, Matthew Lease

We propose a novel three-stage FIND-RESOLVE-LABEL workflow for crowdsourced annotation to reduce ambiguity in task instructions and thus improve annotation quality. Stage 1 (FIND)…