4 papers
XChoice: Explainable Evaluation of AI-Human Alignment in LLM-based Constrained Choice Decision Making
Weihong Qi, Fan Huang, Rasika Muralidharan +2
We present XChoice, an explainable framework for evaluating AI-human alignment in constrained decision making. Moving beyond outcome agreement such as accuracy and F1 score, XChoic…
What Helps Language Models Predict Human Beliefs: Demographics or Prior Stances?
Joseph Malone, Rachith Aiyappa, Byunghwee Lee +3
Beliefs shape how people reason, communicate, and behave. Rather than existing in isolation, they exhibit a rich correlational structure--some connected through logical dependencie…
Can Lessons From Human Teams Be Applied to Multi-Agent Systems? The Role of Structure, Diversity, and Interaction Dynamics
Rasika Muralidharan, Haewoon Kwak, Jisun An
Multi-Agent Systems (MAS) with Large Language Model (LLM)-powered agents are gaining attention, yet fewer studies explore their team dynamics. Inspired by human team science, we pr…
A Cross-Cultural Comparison of LLM-based Public Opinion Simulation: Evaluating Chinese and U.S. Models on Diverse Societies
Weihong Qi, Fan Huang, Jisun An +1
This study evaluates the ability of DeepSeek, an open-source large language model (LLM), to simulate public opinions in comparison to LLMs developed by major tech companies. By com…