Information-Theoretic Measures in AI: A Practical Decision Framework

Nikolaos Al. Papadopoulos, Konstantinos E. Psannis

Information-theoretic (IT) measures are ubiquitous in artificial intelligence: entropy drives decision-tree splits and uncertainty quantification, cross-entropy is the default clas…