2 papers
cs.CL2025
Evaluating how LLM annotations represent diverse views on contentious topics
Megan A. Brown, Shubham Atreja, Libby Hemphill +1
Researchers have proposed the use of generative large language models (LLMs) to label data for research and applied settings. This literature emphasizes the improved performance of…
cs.AI2024
Prompt Design Matters for Computational Social Science Tasks but in Unpredictable Ways
Shubham Atreja, Joshua Ashkinaze, Lingyao Li +2
Manually annotating data for computational social science tasks can be costly, time-consuming, and emotionally draining. While recent work suggests that LLMs can perform such annot…