4 papers
TRACE: Real-Time Multimodal Common Ground Tracking in Situated Collaborative Dialogues
Hannah VanderHoeven, Brady Bhalla, Ibrahim Khebour +11
We present TRACE, a novel system for live *common ground* tracking in situated collaborative tasks. With a focus on fast, real-time performance, TRACE tracks the speech, actions, g…
Speech Is Not Enough: Interpreting Nonverbal Indicators of Common Knowledge and Engagement
Derek Palmer, Yifan Zhu, Kenneth Lai +8
Our goal is to develop an AI Partner that can provide support for group problem solving and social dynamics. In multi-party working group environments, multimodal analytics is cruc…
Common Ground Tracking in Multimodal Dialogue
Ibrahim Khebour, Kenneth Lai, Mariah Bradford +8
Within Dialogue Modeling research in AI and NLP, considerable attention has been spent on ``dialogue state tracking'' (DST), which is the ability to update the representations of t…
How Good is Automatic Segmentation as a Multimodal Discourse Annotation Aid?
Corbyn Terpstra, Ibrahim Khebour, Mariah Bradford +3
Collaborative problem solving (CPS) in teams is tightly coupled with the creation of shared meaning between participants in a situated, collaborative task. In this work, we assess…