Enabling Precise Topic Alignment in Large Language Models Via Sparse Autoencoders

Ananya Joshi, Celia Cintas, Skyler Speakman

Recent work shows that Sparse Autoencoders (SAE) applied to large language model (LLM) layers have neurons corresponding to interpretable concepts. These SAE neurons can be modifie…