27 citations · 66 across the 13 of their papers we have counts for
3 papers · 1 filter
Debiasing Evaluations That are Biased by Evaluations
Jingyan Wang, Ivan Stelmakh, Yuting Wei +1
It is common to evaluate a set of items by soliciting people to rate them. For example, universities ask students to rate the teaching quality of their instructors, and conference…
On the Impossibility of Convex Inference in Human Computation
Nihar B. Shah, Dengyong Zhou
Human computation or crowdsourcing involves joint inference of the ground-truth-answers and the worker-abilities by optimizing an objective function, for instance, by maximizing th…
When is it Better to Compare than to Score?
Nihar B. Shah, Sivaraman Balakrishnan, Joseph Bradley +3
When eliciting judgements from humans for an unknown quantity, one often has the choice of making direct-scoring (cardinal) or comparative (ordinal) measurements. In this paper we…