MetaFormer Is Actually What You Need for Vision

Weihao Yu, Mi Luo, Pan Zhou +5

Transformers have shown great potential in computer vision tasks. A common belief is their attention-based token mixer module contributes most to their competence. However, recent…