activity
20192023
most citedCross-modal Knowledge Reasoning for Knowledge-based Visual Question Answering

116 citations · 189 across the 12 of their papers we have counts for

collaborators

14 papers

cs.CV2023★ 2 cited

VDC: Versatile Data Cleanser based on Visual-Linguistic Inconsistency by Multimodal Large Language Models

Zihao Zhu, Mingda Zhang, Shaokui Wei +2

The role of data in building AI systems has recently been emphasized by the emerging concept of data-centric AI. Unfortunately, in the real-world, datasets may contain dirty sample…

cs.CR2023

Boosting Backdoor Attack with A Learnable Poisoning Sample Selection Strategy

Zihao Zhu, Mingda Zhang, Shaokui Wei +3

Data-poisoning based backdoor attacks aim to insert backdoor into models by manipulating training datasets without controlling the training process of the target model. Existing at…

cs.CV2023★ 3 cited

Versatile Backdoor Attack with Visible, Semantic, Sample-Specific, and Compatible Triggers

Ruotong Wang, Hongrui Chen, Zihao Zhu +2

Deep neural networks (DNNs) can be manipulated to exhibit specific behaviors when exposed to specific trigger patterns, without affecting their performance on benign samples, dubbe…

cs.LG2023

Attacks in Adversarial Machine Learning: A Systematic Survey from the Life-cycle Perspective

Baoyuan Wu, Zihao Zhu, Li Liu +3

Adversarial machine learning (AML) studies the adversarial phenomenon of machine learning, which may make inconsistent or unexpected predictions with humans. Some paradigms have be…

cs.LG2022★ 1 cited

Learning to Optimize Permutation Flow Shop Scheduling via Graph-based Imitation Learning

Longkang Li, Siyuan Liang, Zihao Zhu +3

The permutation flow shop scheduling (PFSS), aiming at finding the optimal permutation of jobs, is widely used in manufacturing systems. When solving large-scale PFSS problems, tra…

cs.CV2022★ 1 cited

From Shallow to Deep: Compositional Reasoning over Graphs for Visual Question Answering

Zihao Zhu

In order to achieve a general visual question answering (VQA) system, it is essential to learn to answer deeper questions that require compositional reasoning on the image and exte…

cs.CV2022

VAC2: Visual Analysis of Combined Causality in Event Sequences

Sujia Zhu, Yue Shen, Zihao Zhu +4

Identifying causality behind complex systems plays a significant role in different domains, such as decision making, policy implementations, and management recommendations. However…

cs.LG2022★ 43 cited

BackdoorBench: A Comprehensive Benchmark of Backdoor Learning

Baoyuan Wu, Hongrui Chen, Mingda Zhang +4

Backdoor learning is an emerging and vital topic for studying deep neural networks' vulnerability (DNNs). Many pioneering backdoor attack and defense methods are being proposed, su…

cs.CV2022★ 1 cited

BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesis

Haiyang Liu, Zihao Zhu, Naoya Iwamoto +5

Achieving realistic, vivid, and human-like synthesized conversational gestures conditioned on multi-modal data is still an unsolved problem due to the lack of available datasets, m…

cs.CL2021★ 1 cited

MCR-Net: A Multi-Step Co-Interactive Relation Network for Unanswerable Questions on Machine Reading Comprehension

Wei Peng, Yue Hu, Jing Yu +4

Question answering systems usually use keyword searches to retrieve potential passages related to a question, and then extract the answer from passages with the machine reading com…

cs.AI2020★ 116 cited

Cross-modal Knowledge Reasoning for Knowledge-based Visual Question Answering

Jing Yu, Zihao Zhu, Yujing Wang +3

Knowledge-based Visual Question Answering (KVQA) requires external knowledge beyond the visible content to answer questions about an image. This ability is challenging but indispen…

cs.CV2020

DAM: Deliberation, Abandon and Memory Networks for Generating Detailed and Non-repetitive Responses in Visual Dialogue

Xiaoze Jiang, Jing Yu, Yajing Sun +4

Visual Dialogue task requires an agent to be engaged in a conversation with human about an image. The ability of generating detailed and non-repetitive responses is crucial for the…

cs.CV2020★ 20 cited

Mucko: Multi-Layer Cross-Modal Knowledge Reasoning for Fact-based Visual Question Answering

Zihao Zhu, Jing Yu, Yujing Wang +3

Fact-based Visual Question Answering (FVQA) requires external knowledge beyond visible content to answer questions about an image, which is challenging but indispensable to achieve…

stat.ML2019★ 1 cited

Measuring Patient Similarities via a Deep Architecture with Medical Concept Embedding

Zihao Zhu, Changchang Yin, Buyue Qian +3

Evaluating the clinical similarities between pairwise patients is a fundamental problem in healthcare informatics. A proper patient similarity measure enables various downstream ap…