6 papers
Reference Games as a Testbed for the Alignment of Model Uncertainty and Clarification Requests
Manar Ali, Judith Sieker, Sina Zarrieà +1
In human conversation, both interlocutors play an active role in maintaining mutual understanding. When listeners are uncertain about what speakers mean, for example, they can requ…
Talking to a Know-It-All GPT or a Second-Guesser Claude? How Repair reveals unreliable Multi-Turn Behavior in LLMs
Clara Lachenmaier, Hannah Bultmann, Sina ZarrieÃ
Repair, an important resource for resolving trouble in human-human conversation, remains underexplored in human-LLM interaction. In this study, we investigate how LLMs engage in th…
LLMs Struggle to Reject False Presuppositions when Misinformation Stakes are High
Judith Sieker, Clara Lachenmaier, Sina ZarrieÃ
This paper examines how LLMs handle false presuppositions and whether certain linguistic factors influence their responses to falsely presupposed content. Presuppositions subtly in…
Can LLMs Ground when they (Don't) Know: A Study on Direct and Loaded Political Questions
Clara Lachenmaier, Judith Sieker, Sina ZarrieÃ
Communication among humans relies on conversational grounding, allowing interlocutors to reach mutual understanding even when they do not have perfect knowledge and must resolve di…
GerPS-Compare: Comparing NER methods for legal norm analysis
Sarah T. Bachinger, Christoph Unger, Robin Erd +4
We apply NER to a particular sub-genre of legal texts in German: the genre of legal norms regulating administrative processes in public service administration. The analysis of such…
Towards an Analysis of Discourse and Interactional Pragmatic Reasoning Capabilities of Large Language Models
Amelie Robrecht, Judith Sieker, Clara Lachenmaier +2
In this work, we want to give an overview on which pragmatic abilities have been tested in LLMs so far and how these tests have been carried out. To do this, we first discuss the s…