170 citations · 364 across the 16 of their papers we have counts for
Showing 2016Show all
2 papers · 1 filter
cs.IR2016
The Effect of Class Imbalance and Order on Crowdsourced Relevance Judgments
Rehab K. Qarout, Alessandro Checco, Gianluca Demartini
In this paper we study the effect on crowd worker efficiency and effectiveness of the dominance of one class in the data they process. We aim at understanding if there is any posit…
cs.IR2016
Pairwise, Magnitude, or Stars: What's the Best Way for Crowds to Rate?
Alessandro Checco, Gianluca Demartini
We compare three popular techniques of rating content: the ubiquitous five star rating, the less used pairwise comparison, and the recently introduced (in crowdsourcing) magnitude…