Improving Evaluation Realism with Inference-Time Compute and Deployment Scaffolds

Axel Ahlqvist, Richard Guan, Juan-Pablo Rivera +6

A core obstacle to alignment evaluation is evaluation awareness: capable models can tell when they are being tested rather than deployed, weakening the conclusions a safety evaluat…