Revealing Hidden Model Behaviors with Task-Specific Self-Reports

Taras Kutsyk, Bartosz Zieliński

Fine-tuning can give a language model a hidden behavior--it may give false answers under a narrow condition, or give harmful advice only when a prompt touches a particular topic. W…