FailSAE: Towards Interpretable Failure Prediction for Vision-Language Models via Sparse Autoencoders

Jie Ma, Zongxi Liu, Yi Zhu

Vision-language models (VLMs), such as CLIP, have achieved strong performance across multimodal tasks by aligning visual and textual representations in a shared embedding space. As…