Steering by Influence: Curvature Aware Data Weighting for Activation Steering

James A. E. Dixon, Stephen J. Roberts, Francesco Quinzan

Inference-time steering offers cheap, fine-grained control over a language model's outputs by estimating a concept's representation in activation space and shifting activations tow…