Sparse Weight and Edge Circuit Discovery in Transformer-based Acoustic Models

Jiankun Wei, Ewan Dunbar, Gerald Penn

Transformer-based foundation models are powerful but opaque, motivating Mechanistic Interpretation methods to uncover the black-box by identifying small computation subgraphs respo…