AlignSAE: Concept-Aligned Sparse Autoencoders

Minglai Yang, Xinyu Guo, Zhengliang Shi +4

Large Language Models (LLMs) encode factual knowledge within hidden parametric spaces that are difficult to inspect or control. While Sparse Autoencoders (SAEs) can decompose hidde…