AI Evaluation Should Work With Humans

Jan Kulveit, Gavin Leech, Tomáš Gavenčiak +1

This position paper argues that the dominant paradigm of AI evaluation (which focuses on superhuman autonomous performance and so implicitly targets the goal of replacing humans) i…