50 citations · 218 across the 15 of their papers we have counts for
17 papers
GenEARL: A Training-Free Generative Framework for Multimodal Event Argument Role Labeling
Hritik Bansal, Po-Nien Kung, P. Jeffrey Brantingham +2
Multimodal event argument role labeling (EARL), a task that assigns a role for each event participant (object) in an image is a complex challenge. It requires reasoning over the en…
Journalistic Guidelines Aware News Image Captioning
Xuewen Yang, Svebor Karaman, Joel Tetreault +1
The task of news article image captioning aims to generate descriptive and informative captions for news article images. Unlike conventional image captions that simply describe the…
Weakly Supervised Visual Semantic Parsing
Alireza Zareian, Svebor Karaman, Shih-Fu Chang
Scene Graph Generation (SGG) aims to extract entities, predicates and their semantic structure from images, enabling deep understanding of visual content, with many applications su…
Bridging Knowledge Graphs to Generate Scene Graphs
Alireza Zareian, Svebor Karaman, Shih-Fu Chang
Scene graphs are powerful representations that parse images into their abstract semantic elements, i.e., objects and their interactions, which facilitates visual comprehension and…
Flow-Distilled IP Two-Stream Networks for Compressed Video Action Recognition
Shiyuan Huang, Xudong Lin, Svebor Karaman +1
Two-stream networks have achieved great success in video recognition. A two-stream network combines a spatial stream of RGB frames and a temporal stream of Optical Flow to make pre…
Detecting and Simulating Artifacts in GAN Fake Images
Xu Zhang, Svebor Karaman, Shih-Fu Chang
To detect GAN generated images, conventional supervised machine learning algorithms require collection of a number of real and fake images from the targeted GAN model. However, the…
Unsupervised Rank-Preserving Hashing for Large-Scale Image Retrieval
Svebor Karaman, Xudong Lin, Xuefeng Hu +1
We propose an unsupervised hashing method which aims to produce binary codes that preserve the ranking induced by a real-valued representation. Such compact hash codes enable the c…
Multi-level Multimodal Common Semantic Space for Image-Phrase Grounding
Hassan Akbari, Svebor Karaman, Surabhi Bhargava +3
We address the problem of phrase grounding by lear ing a multi-level common semantic space shared by the textual and visual modalities. We exploit multiple levels of feature maps o…
Heated-Up Softmax Embedding
Xu Zhang, Felix Xinnan Yu, Svebor Karaman +2
Metric learning aims at learning a distance which is consistent with the semantic meaning of the samples. The problem is generally solved by learning an embedding for each sample s…
Multimodal Social Media Analysis for Gang Violence Prevention
Philipp Blandfort, Desmond Patton, William R. Frey +9
Gang violence is a severe issue in major cities across the U.S. and recent studies [Patton et al. 2017] have found evidence of social media communications that can be linked to suc…
Deep Image Set Hashing
Jie Feng, Svebor Karaman, I-Hong Jhuo +1
In applications involving matching of image sets, the information from multiple images must be effectively exploited to represent each set. State-of-the-art methods use probabilist…
A Multi-Camera Image Processing and Visualization System for Train Safety Assessment
Giuseppe Lisanti, Svebor Karaman, Daniele Pezzatini +1
In this paper we present a machine vision system to efficiently monitor, analyze and present visual data acquired with a railway overhead gantry equipped with multiple cameras. Thi…
Hierarchical Hidden Markov Model in Detecting Activities of Daily Living in Wearable Videos for Studies of Dementia
Svebor Karaman, Jenny Benois-Pineau, Vladislavs Dovgalecs +5
This paper presents a method for indexing activities of daily living in videos obtained from wearable cameras. In the context of dementia diagnosis by doctors, the videos are recor…
Multi-Layer Local Graph Words for Object Recognition
Svebor Karaman, Jenny Benois-Pineau, Rémi Mégret +1
In this paper, we propose a new multi-layer structural approach for the task of object based image retrieval. In our work we tackle the problem of structural organization of local…
Activities of Daily Living Indexing by Hierarchical HMM for Dementia Diagnostics
Svebor Karaman, Jenny Benois-Pineau, Jean-François Dartigues +3
This paper presents a method for indexing human ac- tivities in videos captured from a wearable camera being worn by patients, for studies of progression of the dementia diseases.…
Nested Graph Words for Object Recognition
Svebor Karaman, Jenny Benois-Pineau, Rémi Mégret
In this paper, we propose a new, scalable approach for the task of object based image search or object recognition. Despite the very large literature existing on the scalability is…
Human Daily Activities Indexing in Videos from Wearable Cameras for Monitoring of Patients with Dementia Diseases
Svebor Karaman, Jenny Benois-Pineau, Rémi Mégret +3
Our research focuses on analysing human activities according to a known behaviorist scenario, in case of noisy and high dimensional collected data. The data come from the monitorin…