Correcting Gradient-Based Circuit Localization via Interaction-Aware Backpropagation

Joakim Edin, Casper L. Christensen, Róbert Csordás +5

Circuit localization methods aim to identify the subset of model components responsible for specific behaviors in large language models, enabling detailed mechanistic analysis. Mos…