A Cross-Architecture Audit of Direction-Based Inference-Time Defences in Vision-Language Models

Xiangyu Yin, Tora Bodin, Rohan Menon +1

Inference time defences against vision language model jailbreaks often subtract a calibrated direction from the residual stream at a chosen decoder layer. We compare five defence c…