4 papers
When More Words Say Less: Decoupling Length and Specificity in Image Description Evaluation
Rhea Kapur, Robert Hawkins, Elisa Kreiss
Vision-language models (VLMs) are increasingly used to make visual content accessible via text-based descriptions. In current systems, however, description specificity is often con…
DEBATE: A Large-Scale Benchmark for Evaluating Opinion Dynamics in Role-Playing LLM Agents
Yun-Shiuan Chuang, Ruixuan Tu, Chengtao Dai +9
Accurately modeling opinion change through social interactions is crucial for understanding and mitigating polarization, misinformation, and societal conflict. Recent work simulate…
The Wisdom of Partisan Crowds: Comparing Collective Intelligence in Humans and LLM-based Agents
Yun-Shiuan Chuang, Siddharth Suresh, Nikunj Harlalka +6
Human groups are able to converge on more accurate beliefs through deliberation, even in the presence of polarization and partisan bias -- a phenomenon known as the "wisdom of part…
Simulating Opinion Dynamics with Networks of LLM-based Agents
Yun-Shiuan Chuang, Agam Goyal, Nikunj Harlalka +6
Accurately simulating human opinion dynamics is crucial for understanding a variety of societal phenomena, including polarization and the spread of misinformation. However, the age…