A Geometric Account of Activation Steering through Angle-Norm Decomposition

Georgii Aparin, Tatiana Gaintseva

Linear activation steering has gained popularity as a simple and empirically effective way to control language model behavior. More recently, spherical steering paradigms have been…