KV Cache Steering for Controlling Frozen LLMs

Max Belitsky, Dawid J. Kopiczko, Michael Dorkenwald +4

We propose cache steering, a lightweight method for implicit steering of language models via a one-shot intervention applied directly to the key-value cache. To validate its effect…