Beyond the Linear Separability Ceiling: Aligning Representations in VLMs

Enrico Vompa, Tanel Tammet, Mohit Vaishnav

A challenge in advancing Visual-Language Models (VLMs) is determining whether their failures on abstract reasoning tasks, such as Bongard problems, stem from flawed perception or f…