Identify ambiguous tasks combining crowdsourced labels by weighting Areas Under the Margin

Tanguy Lefort, Benjamin Charlier, Alexis Joly +1

In supervised learning - for instance in image classification - modern massive datasets are commonly labeled by a crowd of workers. The obtained labels in this crowdsourcing settin…