Probing and Steering Evaluation Awareness of Language Models

Jord Nguyen, Khiem Hoang, Carlo Leonardo Attubato +1

Language models can distinguish between testing and deployment phases -- a capability known as evaluation awareness. This has significant safety and policy implications, potentiall…