406 citations · 3.1k across the 87 of their papers we have counts for
7 papers · 1 filter
Cross-media Structured Common Space for Multimedia Event Extraction
Manling Li, Alireza Zareian, Qi Zeng +4
We introduce a new task, MultiMedia Event Extraction (M2E2), which aims to extract events and their arguments from multimedia documents. We develop the first benchmark and collect…
Report of 2017 NSF Workshop on Multimedia Challenges, Opportunities and Research Roadmaps
Shih-Fu Chang, Alex Hauptmann, Louis-Philippe Morency +18
With the transformative technologies and the rapidly changing global R&D landscape, the multimedia and multimodal community is now faced with many new opportunities and uncertainti…
Modeling Multimodal Clues in a Hybrid Deep Learning Framework for Video Classification
Yu-Gang Jiang, Zuxuan Wu, Jinhui Tang +3
Videos are inherently multimodal. This paper studies the problem of how to fully exploit the abundant multimodal clues for improved video categorization. We introduce a hybrid deep…
Columbia MVSO Image Sentiment Dataset
Vaidehi Dalmia, Hongyi Liu, Shih-Fu Chang
The Multilingual Visual Sentiment Ontology (MVSO) consists of 15,600 concepts in 12 different languages that are strongly related to emotions and sentiments expressed in images. Th…
Going Deeper for Multilingual Visual Sentiment Detection
Brendan Jou, Shih-Fu Chang
This technical report details several improvements to the visual concept detector banks built on images from the Multilingual Visual Sentiment Ontology (MVSO). The detector banks a…
Visual Affect Around the World: A Large-scale Multilingual Visual Sentiment Ontology
Brendan Jou, Tao Chen, Nikolaos Pappas +3
Every culture and language is unique. Our work expressly focuses on the uniqueness of culture and language in relation to human affect, specifically sentiment and emotion semantics…
Building A Large Concept Bank for Representing Events in Video
Yin Cui, Dong Liu, Jiawei Chen +1
Concept-based video representation has proven to be effective in complex event detection. However, existing methods either manually design concepts or directly adopt concept librar…