Extraction and Analysis of Multimodal Concepts in Vision Language Models through Sparse Autoencoders

Sergio Lanza, Jae Hee Lee, Stefan Wermter

Vision Language Models (VLMs) have demonstrated impressive performance in tasks requiring joint understanding of images and text, such as image captioning and Visual Question Answe…