The Debate Over Understanding in AI's Large Language Models

Abstract

We survey a current, heated debate in the AI research community on whether large pre-trained language models can be said to "understand" language -- and the physical and social situations language encodes -- in any important sense. We describe arguments that have been made for and against such understanding, and key questions for the broader sciences of intelligence that have arisen in light of these arguments. We contend that a new science of intelligence can be developed that will provide insight into distinct modes of understanding, their strengths and limitations, and the challenge of integrating diverse forms of cognition.

Under submission as a Perspective article. Updated with additional discussion and citations

References in corpus (3)

• Unmasking Clever Hans Predictors and Assessing What Machines Really Learn
• Using cognitive psychology to understand GPT-3
• Large Language Models and the Reverse Turing Test

Cited by in corpus (10)

• Machine Culture
• Exploring Generative AI assisted feedback writing for students' written responses to a physics conceptual question with prompt engineering and few-shot learning
• Evaluating GPT- and Reasoning-based Large Language Models on Physics Olympiad Problems: Surpassing Human Performance and Implications for Educational Assessment
• Six Fallacies in Substituting Large Language Models for Human Participants
• Transforming Agency. On the mode of existence of Large Language Models
• Deanthropomorphising NLP: Can a Language Model Be Conscious?
• Revealing emergent human-like conceptual representations from language prediction
• Structural Similarities Between Language Models and Neural Response Measurements
• Can structural correspondences ground real world representational content in Large Language Models?
• Assessing the nature of large language models: A caution against anthropocentrism