Dynamic Grained Encoder for Vision Transformers

Lin Song, Songyang Zhang, Songtao Liu +5

Transformers, the de-facto standard for language modeling, have been recently applied for vision tasks. This paper introduces sparse queries for vision transformers to exploit the…