Equivariant Sparse Autoencoders: Mechanistic Interpretability of Neural Networks on Symmetric Data

Ege Erdogan, Ana Lucic

Machine learning (ML) models achieve remarkable performance but remain hard to interpret due to their scale and complexity. In particular, their activations entangle many concepts…