Segment Where You Look: Attention as the Interface Between Language Models and Segmenters

Eslam Abdelrahman, Hamza Omar Alkaf, Yuheng Li +5

Vision-language models (VLMs) that segment from language must pass the location of the referent to a pixel decoder. The dominant interface compresses it into the hidden state of a…