A Geometric View for Understanding Concept Learning and Neuron Interpretation in Sparse Autoencoders

Chenhao Zhang, Chris Lin, Su-In Lee

We propose a unified mathematical framework for a geometric understanding of concept learning and neuron interpretation in sparse autoencoders (SAEs). While SAEs improve interpreta…