Answer It or Not? Towards Prompt-Adapted Adversarial Images on Vision Language Models

Shunyuan Bai, Yuchen Ren, Le Yang +3

With the advancement in language modeling, research on adversarial images has recently shifted from image classifiers to vision-language models (VLMs). Despite the new, text-prompt…