Interpret Vision Transformers as ConvNets with Dynamic Convolutions

Chong Zhou, Chen Change Loy, Bo Dai

There has been a debate about the superiority between vision Transformers and ConvNets, serving as the backbone of computer vision models. Although they are usually considered as t…