Revisiting [CLS] and Patch Token Interaction in Vision Transformers

Alexis Marouani, Oriane Siméoni, Hervé Jégou +2

Vision Transformers have emerged as powerful, scalable and versatile representation learners. To capture both global and local features, a learnable [CLS] class token is typically…