RBFormer: Improve Adversarial Robustness of Transformer by Robust Bias

Hao Cheng, Jinhao Duan, Hui Li +6

Recently, there has been a surge of interest and attention in Transformer-based structures, such as Vision Transformer (ViT) and Vision Multilayer Perceptron (VMLP). Compared with…