379 citations · 780 across the 76 of their papers we have counts for
10 papers · 1 filter
Compositional Temporal Visual Grounding of Natural Language Event Descriptions
Jonathan C. Stroud, Ryan McCaffrey, Rada Mihalcea +2
Temporal grounding entails establishing a correspondence between natural language event descriptions and their visual depictions. Compositional modeling becomes central: we first g…
Conversational Transfer Learning for Emotion Recognition
Devamanyu Hazarika, Soujanya Poria, Roger Zimmermann +1
Recognizing emotions in conversations is a challenging task due to the presence of contextual dependencies governed by self- and inter-personal influences. Recent approaches have f…
Towards Automatic Detection of Misinformation in Online Medical Videos
Rui Hou, Verónica Pérez-Rosas, Stacy Loeb +1
Recent years have witnessed a significant increase in the online sharing of medical information, with videos representing a large fraction of such online sources. Previous studies…
Variational Fusion for Multimodal Sentiment Analysis
Navonil Majumder, Soujanya Poria, Gangeshwar Krishnamurthy +3
Multimodal fusion is considered a key step in multimodal tasks such as sentiment analysis, emotion detection, question answering, and others. Most of the recent work on multimodal…
Predicting Human Activities from User-Generated Content
Steven R. Wilson, Rada Mihalcea
The activities we do are linked to our interests, personality, political preferences, and decisions we make about the future. In this paper, we explore the task of predicting human…
Identifying Visible Actions in Lifestyle Vlogs
Oana Ignat, Laura Burdick, Jia Deng +1
We consider the task of identifying human actions visible in online videos. We focus on the widely spread genre of lifestyle vlogs, which consist of videos of people performing act…
Towards Multimodal Sarcasm Detection (An _Obviously_ Perfect Paper)
Santiago Castro, Devamanyu Hazarika, Verónica Pérez-Rosas +3
Sarcasm is often expressed through several verbal and non-verbal cues, e.g., a change of tone, overemphasis in a word, a drawn-out syllable, or a straight looking face. Most of the…
Emotion Recognition in Conversation: Research Challenges, Datasets, and Recent Advances
Soujanya Poria, Navonil Majumder, Rada Mihalcea +1
Emotion is intrinsic to humans and consequently emotion understanding is a key part of human-like artificial intelligence (AI). Emotion recognition in conversation (ERC) is becomin…
Look Who's Talking: Inferring Speaker Attributes from Personal Longitudinal Dialog
Charles Welch, Verónica Pérez-Rosas, Jonathan K. Kummerfeld +1
We examine a large dialog corpus obtained from the conversation history of a single individual with 104 conversation partners. The corpus consists of half a million instant message…
MuSE-ing on the Impact of Utterance Ordering On Crowdsourced Emotion Annotations
Mimansa Jaiswal, Zakaria Aldeneh, Cristian-Paul Bara +4
Emotion recognition algorithms rely on data annotated with high quality labels. However, emotion expression and perception are inherently subjective. There is generally not a singl…