56 citations · 298 across the 31 of their papers we have counts for
9 papers · 1 filter
Towards Modelling Coherence in Spoken Discourse
Rajaswa Patil, Yaman Kumar Singla, Rajiv Ratn Shah +2
While there has been significant progress towards modelling coherence in written discourse, the work in modelling spoken discourse coherence has been quite limited. Unlike the cohe…
LIFI: Towards Linguistically Informed Frame Interpolation
Aradhya Neeraj Mathur, Devansh Batra, Yaman Kumar +2
In this work, we explore a new problem of frame interpolation for speech videos. Such content today forms the major form of online communication. We try to solve this problem by us…
Domain Divergences: a Survey and Empirical Analysis
Abhinav Ramesh Kashyap, Devamanyu Hazarika, Min-Yen Kan +1
Domain divergence plays a significant role in estimating the performance of a model in new domains. While there is a significant literature on divergence measures, researchers find…
Multimodal Research in Vision and Language: A Review of Current and Emerging Trends
Shagun Uppal, Sarthak Bhagat, Devamanyu Hazarika +4
Deep Learning and its applications have cascaded impactful research and development with a diverse range of modalities present in the real-world data. More recently, this has enhan…
Visual Relationship Detection with Visual-Linguistic Knowledge from Multimodal Representations
Meng-Jiun Chiou, Roger Zimmermann, Jiashi Feng
Visual relationship detection aims to reason over relationships among salient objects in images, which has drawn increasing attention over the past few years. Inspired by human rea…
Towards Comprehensive Recommender Systems: Time-Aware UnifiedcRecommendations Based on Listwise Ranking of Implicit Cross-Network Data
Dilruk Perera, Roger Zimmermann
The abundance of information in web applications make recommendation essential for users as well as applications. Despite the effectiveness of existing recommender systems, we find…
Zero-Shot Multi-View Indoor Localization via Graph Location Networks
Meng-Jiun Chiou, Zhenguang Liu, Yifang Yin +2
Indoor localization is a fundamental problem in location-based applications. Current approaches to this problem typically rely on Radio Frequency technology, which requires not onl…
"Notic My Speech" -- Blending Speech Patterns With Multimedia
Dhruva Sahrawat, Yaman Kumar, Shashwat Aggarwal +3
Speech as a natural signal is composed of three parts - visemes (visual part of speech), phonemes (spoken part of speech), and language (the imposed structure). However, video as a…
MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis
Devamanyu Hazarika, Roger Zimmermann, Soujanya Poria
Multimodal Sentiment Analysis is an active area of research that leverages multimodal signals for affective understanding of user-generated videos. The predominant approach, addres…