Reading the Finetuning Prior: Verbatim Content Recovery via Contrastive Decoding Diffing

Michał Brzozowski, Zuzanna Dubanowska, Enrico Cassano +1

Narrowly finetuned language models memorize implanted content verbatim, but auditing what a deployed model has been taught, without access to its weights or training data, remains…