Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probes

Luc Hazenoot, Zhaochun Ren, Amirhossein Zohrehvand

Existing measures of how much a text is about a concept read the surface of the text: dictionary word shares, topic proportions, embedding similarities. They score the words a text…