Beyond Linear Concepts: Discovering and Aligning Non-Linear Concept Manifolds in Large Language Models

Tido Specht, Elias Benedict Krey, Nils Neukirch +1

Understanding information processing in large language models (LLMs) requires dissecting the geometric organization of their internal token representations. While existing mechanis…