Mechanistic Indicators of Understanding in Large Language Models

Pierre Beckmann, Matthieu Queloz

Large language models (LLMs) are often portrayed as merely imitating linguistic patterns without genuine understanding. We argue that recent findings in mechanistic interpretabilit…