Can Interpretation Predict Behavior on Unseen Data?

Victoria R. Li, Jenny Kaufmann, Tian Qin +3

Interpretability research often predicts model responses to targeted mechanistic interventions. But can we predict responses to unseen input data? We propose and demonstrate this a…