Training LLMs to Verbalize Evaluation Awareness

Usman Anwar, Sahar Abdelnabi, David Krueger

Evaluation awareness (EA) can cause large language models (LLMs) to behave differently during audits than in deployment, yet measuring and accounting for EA remains challenging. We…