11 citations · 16 across the 4 of their papers we have counts for
4 papers
A Gold Standard Dataset for the Reviewer Assignment Problem
Ivan Stelmakh, John Wieting, Sarina Xi +2
Many peer-review venues are using algorithms to assign submissions to reviewers. The crux of such automated approaches is the notion of the "similarity score" -- a numerical estima…
Debiasing Evaluations That are Biased by Evaluations
Jingyan Wang, Ivan Stelmakh, Yuting Wei +1
It is common to evaluate a set of items by soliciting people to rate them. For example, universities ask students to rate the teaching quality of their instructors, and conference…
Stretching the Effectiveness of MLE from Accuracy to Bias for Pairwise Comparisons
Jingyan Wang, Nihar B. Shah, R. Ravi
A number of applications (e.g., AI bot tournaments, sports, peer grading, crowdsourcing) use pairwise comparison data and the Bradley-Terry-Luce (BTL) model to evaluate a given col…
On Strategyproof Conference Peer Review
Yichong Xu, Han Zhao, Xiaofei Shi +2
We consider peer review in a conference setting where there is typically an overlap between the set of reviewers and the set of authors. This overlap can incentivize strategic revi…