FishBack: Pullback Fisher Geometry for Optimal Activation Steering in Transformers

Sihan Wang, Jiayi Zhao, Qingyan Cao +2

Activation steering has emerged as a lightweight approach for modifying language model behavior without parameter updates, yet existing methods remain brittle: unstable across laye…