Optimal Crowdsourced Classification with a Reject Option in the Presence of Spammers

Qunwei Li, Pramod K. Varshney

We explore the design of an effective crowdsourcing system for an $M$-ary classification task. Crowd workers complete simple binary microtasks whose results are aggregated to give…