On the Limitations of Steering in Language Model Alignment

Chebrolu Niranjan, Kokil Jaidka, Gerard Christopher Yeo

Steering vectors are a promising approach to aligning language model behavior at inference time. In this paper, we propose a framework to assess the limitations of steering vectors…