You Are What You Read: Misalignment via In-Context Persona Induction

Kyuhee Kim, Benjamin Berczi, Cozmin Ududec

Broad misalignment has been produced by finetuning on narrow data, harmful or benign, and in context only by demonstrations of the undesirable behaviour itself. We show that benign…