Where Steering Signals Come From: Activation Source Selection in Activation Steering

Jiaran Ye, Lingxu Ran, Zijun Yao +5

Activation steering controls language models by adding vectors or features to hidden states at inference time, but the upstream source of these steering signals is often treated as…