How Token Influence Decays with Distance: A Green-Function View of Trained Language Models

Matthias Brändel, Stephan Köhler, Oliver Rheinbach

We study how the next-token prediction of an autoregressive Transformer language model changes under small perturbations of earlier input token embeddings. Motivated by operator le…