GSB: Group Superposition Binarization for Vision Transformer with Limited Training Samples

Tian Gao, Cheng-Zhong Xu, Le Zhang +1

Vision Transformer (ViT) has performed remarkably in various computer vision tasks. Nonetheless, affected by the massive amount of parameters, ViT usually suffers from serious over…