Faster Inference of Integer SWIN Transformer by Removing the GELU Activation

Mohammadreza Tayaranian, Seyyed Hasan Mozafari, James J. Clark +2

SWIN transformer is a prominent vision transformer model that has state-of-the-art accuracy in image classification tasks. Despite this success, its unique architecture causes slow…