Semantic Structure in Large Language Model Embeddings

Austin C. Kozlowski, Callin Dai, Andrei Boutyline

Psychological research consistently finds that human ratings of words across diverse semantic scales can be reduced to a low-dimensional form with relatively little information los…