Topographic Training Concentrates Causal Circuits Without Improving Neuron Monosemanticity

Gautam Ranka, Shubham Santosh Pandere, Aiden Dsouza

Mechanistic interpretability of vision transformers seeks to decompose model computation into human-readable units, but learned representations entangle many concepts in each neuro…