Visual Autoregressive Transformers Must Use $\hat{I}\text{c◯}(n^{2}d)$ Memory

Yang Cao, Xiaoyu Li, Yekun Ke +3

A fundamental challenge in Visual Autoregressive models is the substantial memory overhead required during inference to store previously generated representations. Despite various…