4 papers
AgentAbstain: Do LLM Agents Know When Not to Act?
Xun Liu, Yi Evie Zhang, Vira Kasprova +5
Agent systems based on large language models (LLMs) are increasingly deployed for autonomous tasks, yet existing evaluations mostly focus on task success rather than whether agents…
DialDefer: A Framework for Detecting and Mitigating LLM Dialogic Deference
Parisa Rabbani, Priyam Sahoo, Ruben Mathew +4
LLMs are increasingly used as third-party judges, yet their reliability when evaluating speakers in dialogue remains poorly understood. We show that LLMs judge identical claims dif…
From Fact to Judgment: Investigating the Impact of Task Framing on LLM Conviction in Dialogue Systems
Parisa Rabbani, Nimet Beyza Bozdag, Dilek Hakkani-Tür
LLMs are increasingly employed as judges across a variety of tasks, including those involving everyday social interactions. Yet, it remains unclear whether such LLM-judges can reli…
The Social Gaze of LLMs: A Literature Review of Multimodal Approaches to Human Behavior Understanding
Zihan Liu, Parisa Rabbani, Veda Duddu +3
LLM-powered multimodal systems are increasingly used to interpret human behavior, yet how researchers apply the models' 'social competence' remains poorly understood. This paper pr…