Matryoshka attribution: Learning to attribute language model outputs to representations and weights

Aryaman Arora, Kirill Acharya, Nathan Hu +4

Attributing language model outputs to their internal computations is an open problem in interpretability. Existing methods, which use causal interventions, gradients, or learnable…