Improving Human-Labeled Data through Dynamic Automatic Conflict Resolution

David Q. Sun, Hadas Kotek, Christopher Klein +3

This paper develops and implements a scalable methodology for (a) estimating the noisiness of labels produced by a typical crowdsourcing semantic annotation task, and (b) reducing…