Every Component is a Lookup: Token Attribution and Composition from a Single Decomposition

Po-Kai Chen, Niki van Stein, Aske Plaat

Mechanistic interpretability of transformers requires identifying not just which components matter but how they compose into the computational route that produced a prediction. Bot…