Data-driven Circuit Discovery for Interpretability of Language Models

Daking Rai, Mor Geva, Ziyu Yao

Circuit discovery aims to explain how language models (LMs) implement a specific task by localizing and interpreting a circuit, a computational subgraph responsible for the LM's be…