Measuring Concept Content in Text from LLM Activations: ESG Evidence from Concept Vectors and Linear Probes

Luc Hazenoot, Zhaochun Ren, Amirhossein Zohrehvand

Recent work shows that Large Language Models (LLMs) encode more information in their activations than they show in their responses. We ask whether the information contained in acti…