6 papers
Architectural Backdoors in Vision-Language Model Supply Chains via Representation Steering
Maria Rosaria Briglia, Igor Maljkovic, Antonio Emanuele Cinà +3
Vision--Language Models (VLMs) are increasingly deployed through a model supply chain in which pretrained checkpoints, architecture definitions, text encoders, and exported computa…
Harnessing Hyperbolic Geometry for Harmful Prompt Detection and Sanitization
Igor Maljkovic, Maria Rosaria Briglia, Iacopo Masi +2
Vision-Language Models (VLMs) have become essential for tasks such as image synthesis, captioning, and retrieval by aligning textual and visual information in a shared embedding sp…
Not All Latent Spaces Are Flat: Hyperbolic Concept Control
Maria Rosaria Briglia, Simone Facchiano, Paolo Cursi +6
As modern text-to-image (T2I) models draw closer to synthesizing highly realistic content, the threat of unsafe content generation grows, and it becomes paramount to exercise contr…
Implicit Inversion turns CLIP into a Decoder
Antonio D'Orazio, Maria Rosaria Briglia, Donato Crisostomi +3
CLIP is a discriminative model trained to align images and text in a shared embedding space. Due to its multimodal structure, it serves as the backbone of many generative pipelines…
Understanding Adversarial Training with Energy-based Models
Mujtaba Hussain Mirza, Maria Rosaria Briglia, Filippo Bartolucci +3
We aim at using Energy-based Model (EBM) framework to better understand adversarial training (AT) in classifiers, and additionally to analyze the intrinsic generative capabilities…
What is Adversarial Training for Diffusion Models?
Briglia Maria Rosaria, Mujtaba Hussain Mirza, Giuseppe Lisanti +1
We answer the question in the title, showing that adversarial training (AT) for diffusion models (DMs) fundamentally differs from classifiers: while AT in classifiers enforces outp…