SoT: Delving Deeper into Classification Head for Transformer

Jiangtao Xie, Ruiren Zeng, Qilong Wang +2

Transformer models are not only successful in natural language processing (NLP) but also demonstrate high potential in computer vision (CV). Despite great advance, most of works on…