More than Correlation: Do Large Language Models Learn Causal Representations of Space?

Yida Chen, Yixian Gan, Sijia Li +2

Recent work found high mutual information between the learned representations of large language models (LLMs) and the geospatial property of its input, hinting an emergent internal…