BatchTopK Sparse Autoencoders

Bart Bussmann, Patrick Leask, Neel Nanda

Sparse autoencoders (SAEs) have emerged as a powerful tool for interpreting language model activations by decomposing them into sparse, interpretable features. A popular approach i…