Replace-then-Perturb: Targeted Adversarial Attacks With Visual Reasoning for Vision-Language Models

Jonggyu Jang, Hyeonsu Lyu, Jungyeon Koh +1

The conventional targeted adversarial attacks add a small perturbation to an image to make neural network models estimate the image as a predefined target class, even if it is not…