Optimal Fair Aggregation of Crowdsourced Noisy Labels using Demographic Parity Constraints

Gabriel Singer, Samuel Gruffaz, Olivier Vo Van +2

As acquiring reliable ground-truth labels is usually costly, or infeasible, crowdsourcing and aggregation of noisy human annotations is the typical resort. Aggregating subjective l…