SAEExplainer: Interpreting SAE Features with Activation-Guided Preference Optimization

Jingyi He, Haiyan Zhao, Ruxue Shi +4

Although Sparse Autoencoders (SAEs) have mitigated the opacity of large language models (LLMs) by decomposing dense representations into sparse features, explaining these features…