Prefill Awareness in Large Language Models

Andy Wang, Parv Mahajan, David Demitri Africa +3

Safety-relevant studies of language models, including alignment and jailbreaking evaluations and AI control protocols, often rely on prefilling model outputs. If AI models can reco…