First-Order Steering: Translating Weight Adaptation into Activation Steering

Sri Pranav Kunda, Alexander Kurz, Tomas Dominik +1

Activation steering exploits interpretable directions in the residual stream to enable inference-time manipulation of model behavior. Composing steering vectors to apply multiple t…