Dual Adversarial Fine-tuning for Enhancing Robustness of Large Vision Language Model

Sibo Wang, Jie Zhang, Shiguang Shan +2

While Large Vision-Language Models (LVLMs), represented by LLaVA and GPT-4V, have demonstrated remarkable capabilities, their visual inputs remain vulnerable to adversarial attacks…