Steering Vision-Language Models with Joint Sparse Autoencoders

Huizhen Shu, Xuying Li, Hongxu Lin +2

Sparse Autoencoders (SAEs) have shown promise for analyzing language models, but applying them to vision-language models (VLMs) often yields representations that are difficult to u…