11 papers
Hybrid Panels: Toward Human-AI Collaboration in Survey Research
Julia Romberg, Tobias Gummer, Gabriella Lapesa +2
Large-scale population surveys are essential for generating robust social and scientific insights, yet they face significant challenges, including declining response rates, increas…
Who and What? Using Linguistic Features and Annotator Characteristics to Analyze Annotation Variation
Maximilian Maurer, Maximilian Linde, Gabriella Lapesa
Human label variation has been established as a central phenomenon in NLP: the perspectives different annotators have on the same item need to be embraced. Data collection practice…
From Emotion to Expression: Theoretical Foundations and Resources for Fear Speech
Vigneshwaran Shankaran, Gabriella Lapesa, Claudia Wagner
Few forces rival fear in their ability to mobilize societies, distort communication, and reshape collective behavior. In computational linguistics, fear is primarily studied as an…
Investigating Subjective Factors of Argument Strength: Storytelling, Emotions, and Hedging
Carlotta Quensel, Neele Falk, Gabriella Lapesa
In assessing argument strength, the notions of what makes a good argument are manifold. With the broader trend towards treating subjectivity as an asset and not a problem in NLP, n…
A Modular Taxonomy for Hate Speech Definitions and Its Impact on Zero-Shot LLM Classification Performance
Matteo Melis, Gabriella Lapesa, Dennis Assenmacher
Detecting harmful content is a crucial task in the landscape of NLP applications for Social Good, with hate speech being one of its most dangerous forms. But what do we mean by hat…
Tell Me What You Know About Sexism: Expert-LLM Interaction Strategies and Co-Created Definitions for Zero-Shot Sexism Detection
Myrthe Reuver, Indira Sen, Matteo Melis +1
This paper investigates hybrid intelligence and collaboration between researchers of sexism and Large Language Models (LLMs), with a four-component pipeline. First, nine sexism res…
Towards a Perspectivist Turn in Argument Quality Assessment
Julia Romberg, Maximilian Maurer, Henning Wachsmuth +1
The assessment of argument quality depends on well-established logical, rhetorical, and dialectical properties that are unavoidably subjective: multiple valid assessments may exist…
Toeing the Party Line: Election Manifestos as a Key to Understand Political Discourse on Twitter
Maximilian Maurer, Tanise Ceron, Sebastian Padó +1
Political discourse on Twitter is a moving target: politicians continuously make statements about their positions. It is therefore crucial to track their discourse on social media…
Argument Quality Assessment in the Age of Instruction-Following Large Language Models
Henning Wachsmuth, Gabriella Lapesa, Elena Cabrio +5
The computational treatment of arguments on controversial issues has been subject to extensive NLP research, due to its envisioned impact on opinion formation, decision making, wri…
Political claim identification and categorization in a multilingual setting: First experiments
Urs Zaberer, Sebastian Padó, Gabriella Lapesa
The identification and classification of political claims is an important step in the analysis of political newspaper reports; however, resources for this task are few and far betw…
Between welcome culture and border fence. A dataset on the European refugee crisis in German newspaper reports
Nico Blokker, André Blessing, Erenay Dayanik +3
Newspaper reports provide a rich source of information on the unfolding of public debate on specific policy fields that can serve as basis for inquiry in political science. Such de…