Enhancing Human Evaluation in Machine Translation with Comparative Judgment

Yixiao Song, Parker Riley, Daniel Deutsch +1

Human evaluation is crucial for assessing rapidly evolving language models but is influenced by annotator proficiency and task design. This study explores the integration of compar…