What Do Sparse Autoencoder Feature Discovery Scores Identify? From Activations to Interventions

Yifeng Guo, Yanran Li, Xiang Chen

Sparse autoencoder (SAE) features are typically discovered from how their activations co-vary with behaviour, yet they are often used through interventions such as steering or abla…