Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
What Pretraining and Midtraining Make Learnable from Rewards?
Chiwun Yang, Xiaoyu Li
A reward can identify a correct answer while leaving the computation needed for new inputs undetermined. We study how pretraining and midtraining supply the information and computa…
cs.LG2026
One Spectrum, Two Resources: Data-Memory Scaling in Autoregressive Prediction
Chiwun Yang, Xiaoyu Li
How much learned memory is needed to benefit from more data? We show that the two resources are governed by one predictive-energy spectrum in a positive-entropy autoregressive retr…