Decomposing how prompting steers behavior

Fan L. Cheng, Nikolaus Kriegeskorte

Prompting steers large language models (LLMs) and vision-language models (VLMs) without weight updates, but it remains unclear how instruction changes reshape internal representati…