Query-adaptive Recurrent Tokenization

Bavesh Balaji, Pranav Gopinath, Pouya Sadeghi +1

Visual information worth extracting from an image and the token budget it warrants depend on the text query. Yet modern vision and vision-language models largely encode images inde…