Evaluation Under Imperfect Benchmarks and Ratings: A Case Study in Text Simplification

Joseph Liu, Yoonsoo Nam, Xinyue Cui +1

Despite the successes of language models, their evaluation remains a daunting challenge for new and existing tasks. We consider the task of text simplification, commonly used to im…