From Stories to Features: Scaling Concept Vectors for AI Alignment & Interpretability

Dmitry Scherbakov, Oleg Chernikov, Victoria Khamash +5

We study feature vectors: directions in a language model's activation space that correspond to human-interpretable concepts, such as honesty or deception. Existing unsupervised met…