Synthesizer Based Efficient Self-Attention for Vision Tasks

Guangyang Zhu, Jianfeng Zhang, Yuanzhi Feng +1

Self-attention module shows outstanding competence in capturing long-range relationships while enhancing performance on vision tasks, such as image classification and image caption…