Tensor Memory: Fixed-Size Recurrent State for Long-Horizon Transformers

Kabir Swain, Sijie Han, Daniel Karl I. Weidele +2

Transformers process images and videos by flattening space and time into long token sequences. While attention and KV caching preserve past features, their memory grows with sequen…