Do as I Say, Not as I Do: Instruction-Induction Conflict in LLMs

Carolina Camassa, Derek Shiller

Language models are trained to follow instructions, but they are also powerful pattern completers. What happens when these two objectives conflict? We construct conversations in wh…