3 citations · 5 across the 10 of their papers we have counts for
4 papers · 1 filter
Agents' Last Exam
Yiyou Sun, Xinyang Han, Weichen Zhang +378
Recent AI systems have achieved strong results on a wide range of benchmarks, yet these gains have not translated into economically meaningful deployment across many professional d…
HumanStudy-Bench: Towards AI Agent Design for Participant Simulation
Xuan Liu, Haoyang Shang, Zizhang Liu +4
Large language models (LLMs) are increasingly used as simulated participants in social science experiments, but their behavior is often unstable and highly sensitive to design choi…
CoBRA: Programming Cognitive Bias in Social Agents Using Classic Social Science Experiments
Xuan Liu, Haoyang Shang, Haojian Jin
This paper introduces CoBRA, a novel toolkit for systematically specifying agent behavior in LLM-based social simulation. We found that conventional approaches that specify agent b…
United Minds or Isolated Agents? Exploring Coordination of LLMs under Cognitive Load Theory
HaoYang Shang, Xuan Liu, Zi Liang +3
Large Language Models (LLMs) exhibit a notable performance ceiling on complex, multi-faceted tasks. As practitioners increasingly rely on heavy context engineering -- curating intr…