3 papers
cs.CL2025
Evaluating how LLM annotations represent diverse views on contentious topics
Megan A. Brown, Shubham Atreja, Libby Hemphill +1
Researchers have proposed the use of generative large language models (LLMs) to label data for research and applied settings. This literature emphasizes the improved performance of…
cs.CY2025
Large Language Models Can Be a Viable Substitute for Expert Political Surveys When a Shock Disrupts Traditional Measurement Approaches
Patrick Y. Wu
After a disruptive event or shock, such as the Department of Government Efficiency (DOGE) federal layoffs of 2025, expert judgments are colored by knowledge of the outcome. This ca…
cs.CL2025
Concept-Guided Chain-of-Thought Prompting for Pairwise Comparison Scoring of Texts with Large Language Models
Patrick Y. Wu, Jonathan Nagler, Joshua A. Tucker +1
Existing text scoring methods require a large corpus, struggle with short texts, or require hand-labeled data. We develop a text scoring framework that leverages generative large l…