COMiT: Learning Structured Visual Tokens through Sequential Communication

Aram Davtyan, Yusuf Sahin, Yasaman Haghighi +4

Discrete image tokenizers provide a sequential interface for vision and multimodal models, but are typically optimized for reconstruction or compression and therefore tend to encod…