Deep Transformers Thirst for Comprehensive-Frequency Data

Rui Xia, Chao Xue, Boyu Deng +2

Current researches indicate that inductive bias (IB) can improve Vision Transformer (ViT) performance. However, they introduce a pyramid structure concurrently to counteract the in…