Contrastive Covariance Subspaces for Activation Steering

Alexandros Xenos, Manos Plitsis, Niki Foteinopoulou +2

Activation steering controls large language model behavior by adding a direction to hidden activations during inference. For steering to work well, that direction must be a pure si…