2 papers
cs.IT2026
Information Theory and Statistical Learning
Abbas El Gamal
This manuscript contains preprint of a chapter under consideration for inclusion in the forthcoming third edition of {\em Cover and Thomas's Elements of Information Theory}, posted…
cs.IT2026
Information-theoretic Limits of Learning and Estimation
Abbas El Gamal, Maxim Raginsky
Information theory plays a central role in establishing fundamental limits on what any learning or estimation algorithm can -- and cannot -- achieve, regardless of computational po…