SCAM: A Real-World Typographic Robustness Evaluation for Multimodal Foundation Models

Justus Westerhoff, Erblina Purelku, Jakob Hackstein +4

Typographic attacks exploit the interplay between text and visual content in multimodal foundation models, causing misclassifications when misleading text is embedded within images…