One Spectrum, Two Resources: Data-Memory Scaling in Autoregressive Prediction

Chiwun Yang, Xiaoyu Li

How much learned memory is needed to benefit from more data? We show that the two resources are governed by one predictive-energy spectrum in a positive-entropy autoregressive retr…