Putting Registers to Work: Task Registers for Token Pruning in Vision Transformers

Hongsen Cao, Mona Jaber, Shanxin Yuan +1

Token-pruning policies are usually designed for a single recognition pipeline, but pretrained Vision Transformers are reused across tasks with different spatial demands. We ask whi…