Bottlenecked semantic compression by representation reconstruction

Xiaoya Tang, Shilong Liu, Daniel Smolyak +3

Vision Transformers incur high computational costs when processing long visual token sequences. Existing reduction methods typically rank tokens independently and discard those dee…