PatchDropout: Economizing Vision Transformers Using Patch Dropout

Yue Liu, Christos Matsoukas, Fredrik Strand +2

Vision transformers have demonstrated the potential to outperform CNNs in a variety of vision tasks. But the computational and memory requirements of these models prohibit their us…