Vision Transformer: Vit and its Derivatives

Zujun Fu

Transformer, an attention-based encoder-decoder architecture, has not only revolutionized the field of natural language processing (NLP), but has also done some pioneering work in…