Locating and Steering Refusal Beyond Attention

Preethi Carmel Bosco, Gopalakrishnan Srinivasan

Where inside a language model does refusal live, and does that place change when the architecture does? In a transformer, refusal is governed by a single direction in the residual…