Transformer Circuit Faithfulness Metrics are not Robust

Joseph Miller, Bilal Chughtai, William Saunders

Mechanistic interpretability work attempts to reverse engineer the learned algorithms present inside neural networks. One focus of this work has been to discover 'circuits' -- subg…