Information-theoretic Limits of Learning and Estimation

Abbas El Gamal, Maxim Raginsky

Information theory plays a central role in establishing fundamental limits on what any learning or estimation algorithm can -- and cannot -- achieve, regardless of computational po…