90 citations · 326 across the 21 of their papers we have counts for
19 papers · 1 filter
Attention in Reasoning: Dataset, Analysis, and Modeling
Shi Chen, Ming Jiang, Jinhui Yang +1
While attention has been an increasingly popular component in deep neural networks to both interpret and boost the performance of models, little work has examined how attention pro…
REX: Reasoning-aware and Grounded Explanation
Shi Chen, Qi Zhao
Effectiveness and interpretability are two essential properties for trustworthy AI systems. Most recent studies in visual reasoning are dedicated to improving the accuracy of predi…
Learning to Predict Trustworthiness with Steep Slope Loss
Yan Luo, Yongkang Wong, Mohan S. Kankanhalli +1
Understanding the trustworthiness of a prediction yielded by a classifier is critical for the safe and effective use of AI models. Prior efforts have been proven to be reliable on…
AiR: Attention with Reasoning Capability
Shi Chen, Ming Jiang, Jinhui Yang +1
While attention has been an increasingly popular component in deep neural networks to both interpret and boost performance of models, little work has examined how attention progres…
Saliency Prediction with External Knowledge
Yifeng Zhang, Ming Jiang, Qi Zhao
The last decades have seen great progress in saliency prediction, with the success of deep neural networks that are able to encode high-level semantics. Yet, while humans have the…
Leveraging Bottom-Up and Top-Down Attention for Few-Shot Object Detection
Xianyu Chen, Ming Jiang, Qi Zhao
Few-shot object detection aims at detecting objects with few annotated examples, which remains a challenging research problem yet to be explored. Recent studies have shown the effe…
-Reference Transfer Learning for Saliency Prediction
Yan Luo, Yongkang Wong, Mohan S. Kankanhalli +1
Benefiting from deep learning research and large-scale datasets, saliency prediction has achieved significant success in the past decade. However, it still remains challenging to p…
GradMix: Multi-source Transfer across Domains and Tasks
Junnan Li, Ziwei Xu, Yongkang Wong +2
The computer vision community is witnessing an unprecedented rate of new tasks being proposed and addressed, thanks to the deep convolutional networks' capability to find complex m…
-softmax: Improving Intra-class Compactness and Inter-class Separability of Features
Yan Luo, Yongkang Wong, Mohan Kankanhalli +1
Intra-class compactness and inter-class separability are crucial indicators to measure the effectiveness of a model to produce discriminative features, where intra-class compactnes…
Boosted Attention: Leveraging Human Attention for Image Captioning
Shi Chen, Qi Zhao
Visual attention has shown usefulness in image captioning, with the goal of enabling a caption model to selectively focus on regions of interest. Existing models typically rely on…
Visual Social Relationship Recognition
Junnan Li, Yongkang Wong, Qi Zhao +1
Social relationships form the basis of social structure of humans. Developing computational models to understand social relationships from visual data is essential for building int…
Unsupervised Learning of View-invariant Action Representations
Junnan Li, Yongkang Wong, Qi Zhao +1
The recent success in human action recognition with deep learning methods mostly adopt the supervised learning paradigm, which requires significant amount of manually labeled data…
Interact as You Intend: Intention-Driven Human-Object Interaction Detection
Bingjie Xu, Junnan Li, Yongkang Wong +2
The recent advances in instance-level detection tasks lay strong foundation for genuine comprehension of the visual scenes. However, the ability to fully comprehend a social scene…
Egocentric Spatial Memory
Mengmi Zhang, Keng Teck Ma, Shih-Cheng Yen +3
Egocentric spatial memory (ESM) defines a memory system with encoding, storing, recognizing and recalling the spatial information about the environment from an egocentric perspecti…
Finding any Waldo: zero-shot invariant and efficient visual search
Mengmi Zhang, Jiashi Feng, Keng Teck Ma +3
Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distr…
What am I Searching for: Zero-shot Target Identity Inference in Visual Search
Mengmi Zhang, Gabriel Kreiman
Can we infer intentions from a person's actions? As an example problem, here we consider how to decipher what a person is searching for by decoding their eye movement behavior. We…
Attention Transfer from Web Images for Video Recognition
Junnan Li, Yongkang Wong, Qi Zhao +1
Training deep learning based video classifiers for action recognition requires a large amount of labeled videos. The labeling process is labor-intensive and time-consuming. On the…
Dual-Glance Model for Deciphering Social Relationships
Junnan Li, Yongkang Wong, Qi Zhao +1
Since the beginning of early civilizations, social relationships derived from each individual fundamentally form the basis of social structure in our daily life. In the computer vi…
Learning of Proto-object Representations via Fixations on Low Resolution
Chengyao Shen, Xun Huang, Qi Zhao
While previous researches in eye fixation prediction typically rely on integrating low-level features (e.g. color, edge) to form a saliency map, recently it has been found that the…