Do Sparse Autoencoders Learn Meaningful Concept Hierarchies?

Nils Grandien, David Steinmann, Felix Friedrich +1

Sparse autoencoders (SAEs) have become an important tool for unsupervised concept discovery in large models. To make the resulting feature spaces more interpretable and manageable,…