4 papers
Exposing Functional Fusion: A New Class of Strategic Backdoor in Dynamic Prompt Architectures
Zeyao Liu, Zhendong Zhao, Xiaojun Chen +3
Existing ViT backdoor attacks based on backbone-overwriting full-tuning are computationally expensive and inflict performance degradation. This has forced adversaries towards the V…
Value-Aligned Prompt Moderation via Zero-Shot Agentic Rewriting for Safe Image Generation
Xin Zhao, Xiaojun Chen, Bingshan Liu +3
Generative vision-language models like Stable Diffusion demonstrate remarkable capabilities in creative media synthesis, but they also pose substantial risks of producing unsafe, o…
AILoRA: Function-Aware Asymmetric Initialization for Low-Rank Adaptation of Large Language Models
Xiaoshuang Ji, Zhendong Zhao, Xiaoyan Gu +3
Parameter-efficient finetuning (PEFT) aims to mitigate the substantial computational and memory overhead involved in adapting large-scale pretrained models to diverse downstream ta…
Progtuning: Progressive Fine-tuning Framework for Transformer-based Language Models
Xiaoshuang Ji, Zhendong Zhao, Xiaojun Chen +2
Fine-tuning is a promising technique for leveraging Transformer-based language models in downstream tasks. As model sizes continue to grow, updating all model parameters becomes in…