Causal Interventions on Continuous Variables: A Case Study on Verb Bias in Steering Vectors for In-Context Learning

Zhenghao Herbert Zhou, R. Thomas McCoy, Robert Frank

Causal interventions in language model representations have largely targeted discrete features, like grammatical number. However, language models must also make use of features tha…