Spherical Steering: Geometry-Aware Activation Rotation for Language Models

Zejia You, Chunyuan Deng, Hanjie Chen

Inference-time steering offers a promising way to control language models (LMs) without retraining. However, standard approaches typically rely on activation addition, which inevit…