Efficient Automated Circuit Discovery in Transformers using Contextual Decomposition

Aliyah R. Hsu, Georgia Zhou, Yeshwanth Cherapanamjeri +4

Automated mechanistic interpretation research has attracted great interest due to its potential to scale explanations of neural network internals to large models. Existing automate…