4 papers
Can This LLM Annotate My Data? Estimating Zero-Shot LLM Performance
Tong Lin, Grant Schoenebeck, Sabina Tomkins
Large language models (LLMs) are increasingly used in annotation tasks with varying success. While several studies have demonstrated the opportunities and shortcomings of LLMs for…
AnnotateThis: Analyzing a human-LLM system for annotating social media data with the concept of climate change mitigation pessimism
Zexuan Li, Derek Van Berkel, Ariel Hasell +3
Large language models (LLMs) are increasingly being integrated into research workflows. However, LLMs have been shown to struggle with difficult and nuanced concepts such as those…
Anti-establishment sentiment on TikTok: Implications for understanding influence(rs) and expertise on social media
Tianliang Xu, Ariel Hasell, Sabina Tomkins
Distrust of public serving institutions and anti-establishment views are on the rise (especially in the U.S.). As people turn to social media for information, it is imperative to u…
PUBLICSPEAK: Hearing the Public with a Probabilistic Framework in Local Government
Tianliang Xu, Eva Maxfield Brown, Dustin Dwyer +1
Local governments around the world are making consequential decisions on behalf of their constituents, and these constituents are responding with requests, advice, and assessments…