2 papers
cs.CL2026
A Model Organism for Studying Unverbalized Evaluation Awareness
Daniel Donnelly, Evan Chapple, Haritz Puerto +1
Large language models can recognize when they are being evaluated and change their behavior accordingly, undermining the reliability of safety benchmarks. Evaluation awareness (EA)…
cs.LG2025
Can LLMs subtract numbers?
Mayank Jobanputra, Nils Philipp Walter, Maitrey Mehta +7
We present a systematic study of subtraction in large language models (LLMs). While prior benchmarks emphasize addition and multiplication, subtraction has received comparatively l…