Rethinking Sequence Compression with Test-time Regression

Sihan Yang, Jie Huang, Hanxuan Li +4

Sequence compression is a fundamental operation and a critical information bottleneck in efficient language and multimodal models, and yet prevailing approaches based on pooling or…