Slaying the Hydra: Interaction-Aware Circuit Discovery in Language Models

Sankaran Vaidyanathan, Rafal Urbaniak, Emily Bunnapradist +2

Localizing behavior to individual components of a language model is a central goal of mechanistic interpretability. However, scoring components one at a time misses context-depende…