Learn your entropy from informative data: an axiom ensuring the consistent identification of generalized entropies

Andrea Somazzi, Diego Garlaschelli

Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizat…