From Observation to Intervention: A Causal Audit of Expert Importance in Mixture-of-Experts Models

Leonard Engmann, Christian Medeiros Adriano, Holger Giese

Interpretability methods routinely use population-level summary statistics over observed model behaviour to license claims about the effects of targeted interventions on specific c…