High-Dimensional Random Projection for Activation Steering in Language Models

Minh-Hieu Pham, Bach Do, Laziz Abdullaev +2

Activation steering has emerged as a key methodology for controlling the behavior of large language models (LLMs). Existing difference-in-means based methods, however, are fundamen…