Linguistic Context Recodes Visual Representations in Vision-Language Models

Brian Song, Michael A. Lepori, Ellie Pavlick

Goal-directed visual processing is a hallmark of human visual intelligence, resulting in representations that support downstream tasks such as categorization or search. Though visi…