Decomposing and Measuring Evaluation Awareness

Changling Li, Terry Jingchen Zhang, Jie Zhang +4

Frontier language models sometimes recognize that they are under evaluation and adjust their behavior which can undermine validity of benchmark results. Yet the field studies it wi…