2.4k citations · 2.7k across the 42 of their papers we have counts for
46 papers
Hybrid Forecasting of Geopolitical Events
Daniel M. Benjamin, Fred Morstatter, Ali E. Abbas +26
Sound decision-making relies on accurate prediction for tangible outcomes ranging from military conflict to disease outbreaks. To improve crowdsourced forecasting accuracy, we deve…
Don't Blame the Data, Blame the Model: Understanding Noise and Bias When Learning from Subjective Annotations
Abhishek Anand, Negar Mokhberian, Prathyusha Naresh Kumar +5
Researchers have raised awareness about the harms of aggregating labels especially in subjective tasks that naturally contain disagreements among human annotators. In this work we…
The Pulse of Mood Online: Unveiling Emotional Reactions in a Dynamic Social Media Landscape
Siyi Guo, Zihao He, Ashwin Rao +3
The rich and dynamic information environment of social media provides researchers, policy makers, and entrepreneurs with opportunities to learn about social phenomena in a timely m…
Capturing Perspectives of Crowdsourced Annotators in Subjective Learning Tasks
Negar Mokhberian, Myrl G. Marmarelis, Frederic R. Hopp +3
Supervised classification heavily depends on datasets annotated by humans. However, in subjective tasks such as toxicity classification, these annotations often exhibit low agreeme…
The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendations
Abel Salinas, Parth Vipul Shah, Yuzhong Huang +2
Large Language Models (LLMs) have seen widespread deployment in various real-world applications. Understanding these biases is crucial to comprehend the potential downstream conseq…
Modeling Cross-Cultural Pragmatic Inference with Codenames Duet
Omar Shaikh, Caleb Ziems, William Held +3
Pragmatic reference enables efficient interpersonal communication. Prior work uses simple reference games to test models of pragmatic reasoning, often with unidentified speakers an…