17 papers
ReplicatorBench: Benchmarking LLM Agents for Replicability in Social and Behavioral Sciences
Bang Nguyen, Dominik Soós, Qian Ma +8
The literature has witnessed an emerging interest in AI agents for automated assessment of scientific papers. Existing benchmarks focus primarily on the computational aspect of thi…
Silence and Noise: Self-censorship and Opinion Expression on Social Media
Xinyu Wang, Emma Carpenetti, Bruce Desmarais +1
Unlike the more observable phenomenon of group opinion reinforcement, self-censorship online has received comparatively less attention. Our goal in this work is to dissect the phen…
The Failed Migration of Academic Twitter: A Case Study of Precocious Adopters
Xinyu Wang, Sai Koneru, Sarah Rajtmajer
Following changes in Twitter's ownership in 2022 and subsequent changes to content moderation policies, many in academia looked to move their discourse elsewhere and migration to M…
Demonstrably Informed Consent in Privacy Policy Flows: Evidence from a Randomized Experiment
Qian Ma, Aditya Majumdar, Sarah Rajtmajer +1
Privacy policies govern how personal data is collected, used, and shared. Yet, in most privacy-policy consent flows, agreement is operationalized as a single click at the end of a…
Human-AI Collaboration for Estimating Scientific Replicability
Tatiana Chakravorti, Robert Fraleigh, Timothy Fritton +7
Determining whether published scientific findings can successfully be replicated is a long-standing challenge in the empirical sciences. Existing approaches for replicability asses…
Many Ways to Be Fake: Benchmarking Fake News Detection Under Strategy-Driven AI Generation
Xinyu Wang, Sai Koneru, Wenbo Zhang +3
Recent advances in large language models (LLMs) have enabled the large-scale generation of highly fluent and deceptive news-like content. While prior work has often treated fake ne…