4 citations · 16 across the 43 of their papers we have counts for
20 papers · 1 filter
BadPatch: Diffusion-Based Generation of Physical Adversarial Patches
Zhixiang Wang, Xingjun Ma, Yu-Gang Jiang
Physical adversarial patches printed on clothing can enable individuals to evade person detectors, but most existing methods prioritize attack effectiveness over stealthiness, resu…
Towards Million-Scale Adversarial Robustness Evaluation With Stronger Individual Attacks
Yong Xie, Weijie Zheng, Hanxun Huang +2
As deep learning models are increasingly deployed in safety-critical applications, evaluating their vulnerabilities to adversarial perturbations is essential for ensuring their rel…
IDEATOR: Jailbreaking and Benchmarking Large Vision-Language Models Using Themselves
Ruofan Wang, Juncheng Li, Yixu Wang +6
As large Vision-Language Models (VLMs) gain prominence, ensuring their safe deployment has become critical. Recent studies have explored VLM robustness against jailbreak attacks-te…
Expose Before You Defend: Unifying and Enhancing Backdoor Defenses via Exposed Models
Yige Li, Hanxun Huang, Jiaming Zhang +2
Backdoor attacks covertly implant triggers into deep neural networks (DNNs) by poisoning a small portion of the training data with pre-designed backdoor triggers. This vulnerabilit…
UnSeg: One Universal Unlearnable Example Generator is Enough against All Image Segmentation
Ye Sun, Hao Zhang, Tiehua Zhang +2
Image segmentation is a crucial vision task that groups pixels within an image into semantically meaningful segments, which is pivotal in obtaining a fine-grained understanding of…
BlueSuffix: Reinforced Blue Teaming for Vision-Language Models Against Jailbreak Attacks
Yunhan Zhao, Xiang Zheng, Lin Luo +3
In this paper, we focus on black-box defense for VLMs against jailbreak attacks. Existing black-box defense methods are either unimodal or bimodal. Unimodal methods enhance either…
SIDE: Surrogate Conditional Data Extraction from Diffusion Models
Yunhao Chen, Shujie Wang, Difan Zou +1
As diffusion probabilistic models (DPMs) become central to Generative AI (GenAI), understanding their memorization behavior is essential for evaluating risks such as data leakage,…
Optimizing Cross-Client Domain Coverage for Federated Instruction Tuning of Large Language Models
Zezhou Wang, Yaxin Du, Xingjun Ma +3
Federated domain-specific instruction tuning (FedDIT) for large language models (LLMs) aims to enhance performance in specialized domains using distributed private and limited data…
EnJa: Ensemble Jailbreak on Large Language Models
Jiahao Zhang, Zilong Wang, Ruofan Wang +2
As Large Language Models (LLMs) are increasingly being deployed in safety-critical applications, their vulnerability to potential jailbreaks -- malicious prompts that can disable t…
AdvQDet: Detecting Query-Based Adversarial Attacks with Adversarial Contrastive Prompt Tuning
Xin Wang, Kai Chen, Xingjun Ma +3
Deep neural networks (DNNs) are known to be vulnerable to adversarial attacks even under a black-box setting where the adversary can only query the model. Particularly, query-based…
Downstream Transfer Attack: Adversarial Attacks on Downstream Models with Pre-trained Vision Transformers
Weijie Zheng, Xingjun Ma, Hanxun Huang +2
With the advancement of vision transformers (ViTs) and self-supervised learning (SSL) techniques, pre-trained large ViTs have become the new foundation models for computer vision a…
Constrained Intrinsic Motivation for Reinforcement Learning
Xiang Zheng, Xingjun Ma, Chao Shen +1
This paper investigates two fundamental problems that arise when utilizing Intrinsic Motivation (IM) for reinforcement learning in Reward-Free Pre-Training (RFPT) tasks and Explora…
A Survey of Multimodal-Guided Image Editing with Text-to-Image Diffusion Models
Xincheng Shuai, Henghui Ding, Xingjun Ma +3
Image editing aims to edit the given synthetic or real image to meet the specific requirements from users. It is widely studied in recent years as a promising and challenging field…
CHASE: A Causal Hypergraph based Framework for Root Cause Analysis in Multimodal Microservice Systems
Ziming Zhao, Zhenwei Wang, Tiehua Zhang +7
In recent years, the widespread adoption of distributed microservice architectures within the industry has significantly increased the demand for enhanced system availability and r…
FedCAda: Adaptive Client-Side Optimization for Accelerated and Stable Federated Learning
Liuzhi Zhou, Yu He, Kun Zhai +6
Federated learning (FL) has emerged as a prominent approach for collaborative training of machine learning models across distributed clients while preserving data privacy. However,…
White-box Multimodal Jailbreaks Against Large Vision-Language Models
Ruofan Wang, Xingjun Ma, Hanxu Zhou +3
Recent advancements in Large Vision-Language Models (VLMs) have underscored their superiority in various multimodal tasks. However, the adversarial robustness of VLMs has not been…
ModelLock: Locking Your Model With a Spell
Yifeng Gao, Yuhua Sun, Xingjun Ma +2
This paper presents a novel model protection paradigm ModelLock that locks (destroys) the performance of a model on normal clean data so as to make it unusable or unextractable wit…
FedEGG: Federated Learning with Explicit Global Guidance
Kun Zhai, Yifeng Gao, Difan Zou +4
Federated Learning (FL) holds great potential for diverse applications owing to its privacy-preserving nature. However, its convergence is often challenged by non-IID data distribu…
Whose Side Are You On? Investigating the Political Stance of Large Language Models
Pagnarasmey Pit, Xingjun Ma, Mike Conway +6
Large Language Models (LLMs) have gained significant popularity for their application in various everyday tasks such as text generation, summarization, and information retrieval. A…
Shortcuts Everywhere and Nowhere: Exploring Multi-Trigger Backdoor Attacks
Yige Li, Jiabo He, Hanxun Huang +3
Backdoor attacks have become a significant threat to the pre-training and deployment of deep neural networks (DNNs). Although numerous methods for detecting and mitigating backdoor…