Transformer Field Theory: A Response-Theoretic Approach to Mechanistic Interpretability

David N. Olivieri, Antonio F. Pérez Rodríguez

Mechanistic interpretability often studies Transformer behavior by intervening on internal activations through activation patching, causal tracing, path patching, and steering dire…