activity
20152023
most citedMMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering

10 citations · 22 across the 7 of their papers we have counts for

collaborators

9 papers

cs.LG2023

Improving Replay Sample Selection and Storage for Less Forgetting in Continual Learning

Daniel Brignac, Niels Lobo, Abhijit Mahalanobis

Continual learning seeks to enable deep learners to train on a series of tasks of unknown length without suffering from the catastrophic forgetting of previous tasks. One effective…

cs.CV2023★ 4 cited

Learning Situation Hyper-Graphs for Video Question Answering

Aisha Urooj Khan, Hilde Kuehne, Bo Wu +5

Answering questions about complex situations in videos requires not only capturing the presence of actors, objects, and their relations but also the evolution of these relationship…

cs.CV2022★ 3 cited

Weakly Supervised Grounding for VQA in Vision-Language Transformers

Aisha Urooj Khan, Hilde Kuehne, Chuang Gan +2

Transformers for visual-language representation learning have been getting a lot of interest and shown tremendous performance on visual question answering (VQA) and grounding. But…

cs.CV2021

Found a Reason for me? Weakly-supervised Grounded Visual Question Answering using Capsules

Aisha Urooj Khan, Hilde Kuehne, Kevin Duarte +3

The problem of grounding VQA tasks has seen an increased attention in the research community recently, with most attempts usually focusing on solving this task by using pretrained…

cs.CV2020★ 10 cited

MMFT-BERT: Multimodal Fusion Transformer with BERT Encodings for Visual Question Answering

Aisha Urooj Khan, Amir Mazaheri, Niels da Vitoria Lobo +1

We present MMFT-BERT(MultiModal Fusion Transformer with BERT encodings), to solve Visual Question Answering (VQA) ensuring individual and combined processing of multiple input moda…

cs.CV2020

Deep Photo Cropper and Enhancer

Aaron Ott, Amir Mazaheri, Niels D. Lobo +1

This paper introduces a new type of image enhancement problem. Compared to traditional image enhancement methods, which mostly deal with pixel-wise modifications of a given photo,…

cs.CV2020

Text Synopsis Generation for Egocentric Videos

Aidean Sharghi, Niels da Vitoria Lobo, Mubarak Shah

Mass utilization of body-worn cameras has led to a huge corpus of available egocentric video. Existing video summarization algorithms can accelerate browsing such videos by selecti…

cs.CV2019

Unsupervised Visual Representation Learning with Increasing Object Shape Bias

Zhibo Wang, Shen Yan, Xiaoyu Zhang +1

(Very early draft)Traditional supervised learning keeps pushing convolution neural network(CNN) achieving state-of-art performance. However, lack of large-scale annotation data is…

cs.CV2015★ 5 cited

Understanding Trajectory Behavior: A Motion Pattern Approach

Mahdi M. Kalayeh, Stephen Mussmann, Alla Petrakova +2

Mining the underlying patterns in gigantic and complex data is of great importance to data analysts. In this paper, we propose a motion pattern approach to mine frequent behaviors…