Position-aware Automatic Circuit Discovery

Tal Haklay, Hadas Orgad, David Bau +2

A widely used strategy to discover and understand language model mechanisms is circuit analysis. A circuit is a minimal subgraph of a model's computation graph that executes a spec…