162 citations · 326 across the 8 of their papers we have counts for
8 papers
CMA-CLIP: Cross-Modality Attention CLIP for Image-Text Classification
Huidong Liu, Shaoyuan Xu, Jinmiao Fu +5
Modern Web systems such as social media and e-commerce contain rich contents expressed in images and text. Leveraging information from multi-modalities can improve the performance…
Explainable Deep Learning: A Field Guide for the Uninitiated
Gabrielle Ras, Ning Xie, Marcel van Gerven +1
Deep neural networks (DNNs) have become a proven and indispensable machine learning tool. As a black-box model, it remains difficult to diagnose what aspects of the model's input d…
Contextual Grounding of Natural Language Entities in Images
Farley Lai, Ning Xie, Derek Doran +1
In this paper, we introduce a contextual grounding approach that captures the context in corresponding text entities and image regions to improve the grounding accuracy. Specifical…
Visual Entailment: A Novel Task for Fine-Grained Image Understanding
Ning Xie, Farley Lai, Derek Doran +1
Existing visual reasoning datasets such as Visual Question Answering (VQA), often suffer from biases conditioned on the question, image or answer distributions. The recently propos…
Reasoning over RDF Knowledge Bases using Deep Learning
Monireh Ebrahimi, Md Kamruzzaman Sarker, Federico Bianchi +3
Semantic Web knowledge representation standards, and in particular RDF and OWL, often come endowed with a formal semantics which is considered to be of fundamental importance for t…
Visual Entailment Task for Visually-Grounded Language Learning
Ning Xie, Farley Lai, Derek Doran +1
We introduce a new inference task - Visual Entailment (VE) - which differs from traditional Textual Entailment (TE) tasks whereby a premise is defined by an image, rather than a na…
Relating Input Concepts to Convolutional Neural Network Decisions
Ning Xie, Md Kamruzzaman Sarker, Derek Doran +2
Many current methods to interpret convolutional neural networks (CNNs) use visualization techniques and words to highlight concepts of the input seemingly relevant to a CNN's decis…
Explaining Trained Neural Networks with Semantic Web Technologies: First Steps
Md Kamruzzaman Sarker, Ning Xie, Derek Doran +2
The ever increasing prevalence of publicly available structured data on the World Wide Web enables new applications in a variety of domains. In this paper, we provide a conceptual…