Reviewer Scores Are Not Comparable Across Research Areas in ML Peer Review

Binyan Xu, Xilin Dai, Fan Yang +1

Peer review at ML conferences increasingly relies on reviewer scores as the primary decision instrument. As submissions have scaled from thousands to tens of thousands per year, no…