Reinforcement Learning-based Token Pruning in Vision Transformers: A Markov Game Approach

Chenglong Lu, Shen Liang, Xuewei Wang +1

Vision Transformers (ViTs) have computational costs scaling quadratically with the number of tokens, calling for effective token pruning policies. Most existing policies are handcr…