Non-Gaussianity Reveals Interpretable Directions in Language Models

Sida Liu, Feijiang Han, Sarah Wiegreffe +1

Finding human-interpretable directions in language-model activations is important for understanding and controlling model behavior. These directions are usually discovered through…