Efficient Token Compression for Vision Transformer with Spatial Information Preserved

Junzhu Mao, Yang Shen, Jinyang Guo +2

Token compression is essential for reducing the computational and memory requirements of transformer models, enabling their deployment in resource-constrained environments. In this…