5 papers · 1 filter
MMKG-R1: Constructing Multimodal Knowledge Graphs via Reinforcement Learning
Zongyu Wu, Yilong Wang, Xiaochen Wang +5
Multimodal knowledge graphs (MMKGs) organize information across different modalities to support multimodal Graph Retrieval-Augmented Generation (RAG), which aims to improve the per…
Multi-Granularity Context-Enhanced RAG over Multimodal Knowledge Graphs
Zongyu Wu, Yilong Wang, Xiaochen Wang +5
Retrieval-augmented generation (RAG) is widely used to mitigate hallucination issues in large language models (LLMs) and multimodal large language models (MLLMs). In particular, kn…
MKG-RAG-Bench: Benchmarking Retrieval in Multimodal Knowledge Graph-Augmented Generation
Xiaochen Wang, Bao Hoang, Han Liu +2
Retrieval-augmented generation (RAG) over knowledge graphs has emerged as a promising approach for grounding large language models, yet existing benchmarks largely overlook the cha…
SEP-Attack: A Simple and Effective Paradigm for Transfer-Based Textual Adversarial Attack
Han Liu, Zhi Xu, Xiaotong Zhang +5
Despite the strong performance of deep neural networks in modern Web and language applications, they remain vulnerable to adversarial attacks, especially transferable attacks that…
HQA-VLAttack: Towards High Quality Adversarial Attack on Vision-Language Pre-Trained Models
Han Liu, Jiaqi Li, Zhi Xu +5
Black-box adversarial attack on vision-language pre-trained models is a practical and challenging task, as text and image perturbations need to be considered simultaneously, and on…