CROWDLAB: Supervised learning to infer consensus labels and quality scores for data with multiple annotators

Hui Wen Goh, Ulyana Tkachenko, Jonas Mueller

Real-world data for classification is often labeled by multiple annotators. For analyzing such data, we introduce CROWDLAB, a straightforward approach to utilize any trained classi…