Predicting Token Impact Towards Efficient Vision Transformer

Hong Wang, Su Yang, Xiaoke Huang +1

Token filtering to reduce irrelevant tokens prior to self-attention is a straightforward way to enable efficient vision Transformer. This is the first work to view token filtering…