MLP Can Be A Good Transformer Learner

Sihao Lin, Pumeng Lyu, Dongrui Liu +4

Self-attention mechanism is the key of the Transformer but often criticized for its computation demands. Previous token pruning works motivate their methods from the view of comput…