Redundancy as a Structural Information Principle for Learning and Generalization

Yuda Bi, Ying Zhu, Vince D Calhoun

We present a theoretical framework that extends classical information theory to finite and structured systems by redefining redundancy as a fundamental property of information orga…