11 citations · 13 across the 7 of their papers we have counts for
12 papers
Naturalistic Head Motion Generation from Speech
Trisha Mittal, Zakaria Aldeneh, Masha Fedzechkina +2
Synthesizing natural head motion to accompany speech for an embodied conversational agent is necessary for providing a rich interactive experience. Most prior works assess the qual…
3MASSIV: Multilingual, Multimodal and Multi-Aspect dataset of Social Media Short Videos
Vikram Gupta, Trisha Mittal, Puneet Mathur +5
We present 3MASSIV, a multilingual, multimodal and multi-aspect, expertly-annotated dataset of diverse short videos extracted from short-video social media platform - Moj. 3MASSIV…
Affect2MM: Affective Analysis of Multimedia Content Using Emotion Causality
Trisha Mittal, Puneet Mathur, Aniket Bera +1
We present Affect2MM, a learning method for time-series emotion prediction for multimedia content. Our goal is to automatically capture the varying emotions depicted by characters…
Dynamic Graph Modeling of Simultaneous EEG and Eye-tracking Data for Reading Task Identification
Puneet Mathur, Trisha Mittal, Dinesh Manocha
We present a new approach, that we call AdaGTCN, for identifying human reader intent from Electroencephalogram~(EEG) and Eye movement~(EM) data in order to help differentiate betwe…
MCQA: Multimodal Co-attention Based Network for Question Answering
Abhishek Kumar, Trisha Mittal, Dinesh Manocha
We present MCQA, a learning-based algorithm for multimodal question answering. MCQA explicitly fuses and aligns the multimodal input (i.e. text, audio, and video), which forms the…
EmotiCon: Context-Aware Multimodal Emotion Recognition using Frege's Principle
Trisha Mittal, Pooja Guhan, Uttaran Bhattacharya +3
We present EmotiCon, a learning-based algorithm for context-aware perceived human emotion recognition from videos and images. Motivated by Frege's Context Principle from psychology…