6 papers · 1 filter
Talking to a Know-It-All GPT or a Second-Guesser Claude? How Repair reveals unreliable Multi-Turn Behavior in LLMs
Clara Lachenmaier, Hannah Bultmann, Sina Zarrieß
Repair, an important resource for resolving trouble in human-human conversation, remains underexplored in human-LLM interaction. In this study, we investigate how LLMs engage in th…
Reference Games as a Testbed for the Alignment of Model Uncertainty and Clarification Requests
Manar Ali, Judith Sieker, Sina Zarrieß +1
In human conversation, both interlocutors play an active role in maintaining mutual understanding. When listeners are uncertain about what speakers mean, for example, they can requ…
Can LLMs Ground when they (Don't) Know: A Study on Direct and Loaded Political Questions
Clara Lachenmaier, Judith Sieker, Sina Zarrieß
Communication among humans relies on conversational grounding, allowing interlocutors to reach mutual understanding even when they do not have perfect knowledge and must resolve di…
LLMs Struggle to Reject False Presuppositions when Misinformation Stakes are High
Judith Sieker, Clara Lachenmaier, Sina Zarrieß
This paper examines how LLMs handle false presuppositions and whether certain linguistic factors influence their responses to falsely presupposed content. Presuppositions subtly in…
GerPS-Compare: Comparing NER methods for legal norm analysis
Sarah T. Bachinger, Christoph Unger, Robin Erd +4
We apply NER to a particular sub-genre of legal texts in German: the genre of legal norms regulating administrative processes in public service administration. The analysis of such…
Towards an Analysis of Discourse and Interactional Pragmatic Reasoning Capabilities of Large Language Models
Amelie Robrecht, Judith Sieker, Clara Lachenmaier +2
In this work, we want to give an overview on which pragmatic abilities have been tested in LLMs so far and how these tests have been carried out. To do this, we first discuss the s…