Words as Difference Makers: How Large Language Models Determine Causal Structure in Text

Wolfgang Pietsch

Because large language models (LLMs) are impressively successful in predicting text, it appears that they must have access to a 'world model' representing causal and definitional s…