4 papers
Flout at Your Own Risk: LLMs Struggle with Pragmatic Cooperativity Under Epistemic Asymmetry
Hannah VanderHoeven, Abhijnan Nath, Nikhil Krishnaswamy
Fruitful collaborations require effective communication of privately-held information. The increasing use of LLMs as "collaborators" raises questions about the extent to which they…
CRAFT: Grounded Multi-Agent Coordination Under Partial Information
Abhijnan Nath, Hannah VanderHoeven, Nikhil Krishnaswamy
We introduce CRAFT, a multi-agent benchmark for evaluating pragmatic communication in large language models under strict partial information. In this setting, multiple agents with…
TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues
Hannah VanderHoeven, Brady Bhalla, Ibrahim Khebour +11
We present TRACE, a novel system for live *common ground* tracking in situated collaborative tasks. With a focus on fast, real-time performance, TRACE tracks the speech, actions, g…
Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement
Derek Palmer, Yifan Zhu, Kenneth Lai +8
Our goal is to develop an AI Partner that can provide support for group problem solving and social dynamics. In multi-party working group environments, multimodal analytics is cruc…