1 paper · 1 filter
Masoud Kavian, Abdellatif Zaidi, Milad Sefidgaran
We develop an information-theoretic framework for generalization in next-token prediction under temporally dependent data. We consider independent trajectories generated by finite-…