4 papers
Theory Trace Card: Theory-Driven Socio-Cognitive Evaluation of LLMs
Farzan Karimi-Malekabadi, Suhaib Abdurahman, Zhivar Sourati +2
Socio-cognitive benchmarks for large language models (LLMs) often fail to predict real-world behavior, even when models achieve high benchmark scores. Prior work has attributed thi…
The Homogenizing Effect of Large Language Models on Human Expression and Thought
Zhivar Sourati, Alireza S. Ziabari, Morteza Dehghani
Cognitive diversity, reflected in variations of language, perspective, and reasoning, is essential to creativity and collective intelligence. This diversity is rich and grounded in…
CoCo-CoLa: Evaluating and Improving Language Adherence in Multilingual LLMs
Elnaz Rahmati, Alireza S. Ziabari, Morteza Dehghani
Multilingual Large Language Models (LLMs) develop cross-lingual abilities despite being trained on limited parallel data. However, they often struggle to generate responses in the…
Reasoning on a Spectrum: Aligning LLMs to System 1 and System 2 Thinking
Alireza S. Ziabari, Nona Ghazizadeh, Zhivar Sourati +3
Large Language Models (LLMs) exhibit impressive reasoning abilities, yet their reliance on structured step-by-step processing reveals a critical limitation. In contrast, human cogn…