Adversarial Decoys: Misdirecting Attention-Based Defenses in ViT

Giulia Marchiori Pietrosanti, Giulio Rossolini, Giorgio Buttazzo

Vision Transformers (ViTs) remain vulnerable to localized adversarial attacks, e.g., adversarial patches, while recent test-time defenses mitigate them by suppressing image tokens…