193 citations · 565 across the 21 of their papers we have counts for
4 papers · 1 filter
: Compositional Counterfactual Contrastive Learning for Video-grounded Dialogues
Hung Le, Nancy F. Chen, Steven C. H. Hoi
Video-grounded dialogue systems aim to integrate video understanding and dialogue understanding to generate responses that are relevant to both the dialogue and video context. Most…
VGNMN: Video-grounded Neural Module Network to Video-Grounded Language Tasks
Hung Le, Nancy F. Chen, Steven C. H. Hoi
Neural module networks (NMN) have achieved success in image-grounded tasks such as Visual Question Answering (VQA) on synthetic images. However, very limited work on NMN has been s…
Learning Reasoning Paths over Semantic Graphs for Video-grounded Dialogues
Hung Le, Nancy F. Chen, Steven C. H. Hoi
Compared to traditional visual question answering, video-grounded dialogues require additional reasoning over dialogue context to answer questions in a multi-turn setting. Previous…
DVD: A Diagnostic Dataset for Multi-step Reasoning in Video Grounded Dialogue
Hung Le, Chinnadhurai Sankar, Seungwhan Moon +3
A video-grounded dialogue system is required to understand both dialogue, which contains semantic dependencies from turn to turn, and video, which contains visual cues of spatial a…