A Thermodynamic Theory of Learning I: Irreversible Ensemble Transport and Epistemic Costs

Daisuke Okanohara

Learning systems acquire structured internal representations from data, yet classical information-theoretic results state that deterministic transformations do not increase informa…