3 papers
stat.ML2026
Information-Theoretic Analysis of Next-Token Prediction under Markovian Data
Masoud Kavian, Abdellatif Zaidi, Milad Sefidgaran
We develop an information-theoretic framework for generalization in next-token prediction under temporally dependent data. We consider independent trajectories generated by finite-…
cs.LG2025
Heterogeneity Matters even More in Distributed Learning: Study from Generalization Perspective
Masoud Kavian, Romain Chor, Milad Sefidgaran +1
In this paper, we investigate the effect of data heterogeneity across clients on the performance of distributed learning systems, i.e., one-round Federated Learning, as measured by…
cs.IT2023
Output Statistics of Random Binning: Tsallis Divergence and Its Applications
Masoud Kavian, Mohammad Mahdi Mojahedian, Mohammad Hossein Yassaee +2
Random binning is a widely used technique in information theory with diverse applications. In this paper, we focus on the output statistics of random binning (OSRB) using the Tsall…