13 papers
One Prompt Is Enough: Watermark Laundering Through Foundation Image Models
Jidong Yang, Qi Li, Wei Zong +5
Invisible watermarks are typically evaluated against predefined perturbations such as compression, blur, noise, cropping, and denoising. Public foundation image models expose a dis…
SkillShield: Prompt-Space Security Skills for LLM Coding Agents
Xiaodong Wu, Zhimin Zhao, Qi Li +4
A coding agent edits files and executes shell commands with its developer's privileges, allowing malicious requests to translate directly into harmful actions or functional malware…
EVOMAL: Self-Poisoning in Self-Evolving Coding Agents
Xiaodong Wu, Yu Shi, Qi Li +5
Self-evolving LLM coding agents write their own tools by imitating retrieved skills from shared skill libraries. We identify a vulnerability in this loop: during authoring, a retri…
MarkNull: Model-Agnostic Watermark Removal in AI-Generated Images via On-Manifold Latent Manipulation
Jie Cao, Qi Li, Zelin Zhang +4
Digital watermarking has emerged as a critical technique for provenance and copyright attribution in AI-generated imagery, yet its robustness against realistic, model-agnostic remo…
Are Watermarked Images Editable? SafeMark for Watermark-Preserving Text-Guided Image Editing
Xiaodong Wu, Qi Li, Xiangman Li +3
This paper investigates a fundamental yet underexplored question: can watermarked images remain editable without compromising watermark integrity? We propose SafeMark, a framework…
From AI-Generated Content to Agentic Action: Security and Safety Threats in Generative AI
Zelin Zhang, Qi Li, Jie Cao +2
Generative AI systems are increasingly used not only to produce content but also to retrieve data, invoke tools, and execute actions. This work examines the security and safety imp…
MelShield: Robust Mel-Domain Audio Watermarking for Provenance Attribution of AI Generated Synthesized Speech
Yutong Jin, Qi Li, Lingshuang Liu +1
In this paper, we propose MelShield, a robust, in-generation, keyed audio watermarking framework that embeds identifiable signals into AI-generated audio for copyright protection a…
MarkSweep: A No-box Removal Attack on AI-Generated Image Watermarking via Noise Intensification and Frequency-aware Denoising
Jie Cao, Zelin Zhang, Qi Li +1
AI watermarking embeds invisible signals within images to provide provenance information and identify content as AI-generated. In this paper, we introduce MarkSweep, a novel waterm…
Secure and Robust Watermarking for AI-generated Images: A Comprehensive Survey
Jie Cao, Qi Li, Zelin Zhang +2
The rapid progress of Generative Artificial Intelligence (GenAI) has enabled the effortless synthesis of high-quality visual content, while simultaneously raising pressing concerns…
SafeLLM: Unlearning Harmful Outputs from Large Language Models against Jailbreak Attacks
Xiangman Li, Xiaodong Wu, Qi Li +2
Jailbreak attacks pose a serious threat to the safety of Large Language Models (LLMs) by crafting adversarial prompts that bypass alignment mechanisms, causing the models to produc…
Robustness Assessment and Enhancement of Text Watermarking for Google's SynthID
Xia Han, Qi Li, Jianbing Ni +1
Recent advances in LLM watermarking methods such as SynthID-Text by Google DeepMind offer promising solutions for tracing the provenance of AI-generated text. However, our robustne…
SecureT2I: No More Unauthorized Manipulation on AI Generated Images from Prompts
Xiaodong Wu, Xiangman Li, Qi Li +2
Text-guided image manipulation with diffusion models enables flexible and precise editing based on prompts, but raises ethical and copyright concerns due to potential unauthorized…
SoK: A Comprehensive Security Analysis of Jailbreak Resilience in GPT and DeepSeek Models
Xiaodong Wu, Xiangman Li, Qi Li +2
The rapid proliferation of Large Language Models (LLMs) has heightened concerns regarding their exposure to jailbreak attacks, which craft adversarial inputs designed to elicit uns…