Local Learning on Transformers via Feature Reconstruction

Priyank Pathak, Jingwei Zhang, Dimitris Samaras

Transformers are becoming increasingly popular due to their superior performance over conventional convolutional neural networks(CNNs). However, transformers usually require a much…