Investigating Multimodal Informativity under Different Partner Visibility Conditions in Video-Mediated Dialogue

Esam Ghaleb, Hugh Mee Wong, Kristina Kobrock

Situated language use is multimodal and embodied. For example, gestures can carry information that is absent or underspecified in the speech signal, yet dialogue models typically r…