10 papers
ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction
Zichun Guo, Yuling Shi, Wenhao Zeng +6
Multimodal Large Language Models (MLLMs) have achieved remarkable performance in Visually Rich Document Understanding (VRDU) tasks, but their capabilities are mainly evaluated on p…
DO-Bench: An Attributable Benchmark for Diagnosing Object Hallucination in Vision-Language Models
JiYang Wang, Jiawei Chen, Mengqi Xiao +3
Object level hallucination remains a central reliability challenge for vision language models (VLMs), particularly in binary object existence verification. Existing benchmarks emph…
Who Can See Through You? Adversarial Shielding Against VLM-Based Attribute Inference Attacks
Yucheng Fan, Jiawei Chen, Yu Tian +1
As vision-language models (VLMs) become widely adopted, VLM-based attribute inference attacks have emerged as a serious privacy concern, enabling adversaries to infer private attri…
Red Teaming Large Reasoning Models
Jiawei Chen, Yang Yang, Chao Yu +6
Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, offering enhanced transparency and logical consistency through explicit chains o…
KG-DF: A Black-box Defense Framework against Jailbreak Attacks Based on Knowledge Graphs
Shuyuan Liu, Jiawei Chen, Xiao Yang +2
With the widespread application of large language models (LLMs) in various fields, the security challenges they face have become increasingly prominent, especially the issue of jai…
CLASP: Training-Free LLM-Assisted Source Code Watermarking via Semantic-Preserving Transformations
Rui Xu, Jiawei Chen, Weizhi Liu +3
The proliferation of open-source code and large language models (LLMs) for code generation has amplified the risks of unauthorized reuse and intellectual property infringement. Sou…