SAGE: Scalable Ground Truth Evaluations for Large Sparse Autoencoders

Constantin Venhoff, Anisoara Calinescu, Philip Torr +1

A key challenge in interpretability is to decompose model activations into meaningful features. Sparse autoencoders (SAEs) have emerged as a promising tool for this task. However,…