3 papers
cs.LG2021
The Science of Rejection: A Research Area for Human Computation
Burcu Sayin, Jie Yang, Andrea Passerini +1
We motivate why the science of learning to reject model predictions is central to ML, and why human computation has a lead role in this effort.
cs.HC2021
On the state of reporting in crowdsourcing experiments and a checklist to aid current practices
Jorge Ramírez, Burcu Sayin, Marcos Baez +4
Crowdsourcing is being increasingly adopted as a platform to run studies with human subjects. Running a crowdsourcing experiment involves several choices and strategies to successf…
cs.IR2020
Active Learning from Crowd in Document Screening
Evgeny Krivosheev, Burcu Sayin, Alessandro Bozzon +1
In this paper, we explore how to efficiently combine crowdsourcing and machine intelligence for the problem of document screening, where we need to screen documents with a set of m…