Non-native speakers of English or ChatGPT: Who thinks better?

Abstract

This study sets out to answer one major question: Who thinks better, non-native speakers of English or ChatGPT?, providing evidence from processing and interpreting center-embedding English constructions that human brain surpasses ChatGPT, and that ChatGPT cannot be regarded as a theory of language. Fifteen non-native speakers of English were recruited as participants of the study. A center-embedding English sentence was presented to both the study participants and ChatGPT. The study findings unveil that human brain is still far ahead of Large Language Models, specifically ChatGPT, even in the case of non-native speakers of an L2, here English. The study concludes that human brain's ability to process and interpret natural language data is unique and that ChatGPT still lags behind this human unique ability.

16 pages, 2 figures

References in corpus (5)

• Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT
• Scaling Sentence Embeddings with Large Language Models
• Why Linguistics Will Thrive in the 21st Century: A Reply to Piantadosi (2023)
• Generative linguistics contribution to artificial intelligence: Where this contribution lies?
• Enhancing Embedding Performance through Large Language Model-based Text Enrichment and Rewriting