65 citations · 151 across the 8 of their papers we have counts for
9 papers
Cross-Modal Coherence for Text-to-Image Retrieval
Malihe Alikhani, Fangda Han, Hareesh Ravi +3
Common image-text joint understanding techniques presume that images and the associated text can universally be characterized by a single implicit model. However, co-occurring imag…
Discourse Coherence, Reference Grounding and Goal Oriented Dialogue
Baber Khalid, Malihe Alikhani, Michael Fellner +2
Prior approaches to realizing mixed-initiative human--computer referential communication have adopted information-state or collaborative problem-solving approaches. In this paper,…
Clue: Cross-modal Coherence Modeling for Caption Generation
Malihe Alikhani, Piyush Sharma, Shengjie Li +2
We use coherence relations inspired by computational models of discourse to study the information needs and goals of image captioning. Using an annotation protocol specifically dev…
That and There: Judging the Intent of Pointing Actions with Robotic Arms
Malihe Alikhani, Baber Khalid, Rahul Shome +3
Collaborative robotics requires effective communication between a robot and a human partner. This work proposes a set of interpretive principles for how a robotic arm can use point…
AI2D-RST: A multimodal corpus of 1000 primary school science diagrams
Tuomo Hiippala, Malihe Alikhani, Jonas Haverinen +6
This article introduces AI2D-RST, a multimodal corpus of 1000 English-language diagrams that represent topics in primary school natural sciences, such as food webs, life cycles, mo…
CITE: A Corpus of Image-Text Discourse Relations
Malihe Alikhani, Sreyasi Nag Chowdhury, Gerard de Melo +1
This paper presents a novel crowd-sourced resource for multimodal discourse: our resource characterizes inferences in image-text contexts in the domain of cooking recipes in the fo…