Evaluation Awareness in Language Models: Representation, Verbalization, and Control

Farzaneh Heidari, Amin Memarian, Guillaume Rabusseau

Both capability and safety benchmarks rest upon the assumption that the behavior of language models undergoing a test is informative about their behavior in deployment. This assump…