Comparing Sparsified MLPs and Transcoders: Many Transcoder Features Are Neurons in Disguise

Stepan Shabalin, Mateusz Piotrowski

MLP neurons in transformer language models are widely understood to be polysemantic, motivating transcoders - sparse, learned approximations of MLP layers - as interpretable replac…