The Sharp Directions Are Against You: Curvature Analysis of Activation Steering

Seyedarmin Azizi, Arya Fayyazi, Parsa Razmara +3

Activation steering adds a vector to a language model's internal representations at inference time. It is a lightweight alternative to fine-tuning for behavioral control. The stand…