A 2D Semantic-Aware Position Encoding for Vision Transformers

Xi Chen, Shiyang Zhou, Muqi Huang +9

Vision transformers have demonstrated significant advantages in computer vision tasks due to their ability to capture long-range dependencies and contextual relationships through s…