A Conditional No-Hair Theorem for Transformers: How Language Models Forget Their Prompt

Shuyang Xiang

We ask how much an autoregressive transformer retains of its prompt after generating $t$ tokens. Consider two different prompts followed by the same continuation text, so that any…