3 papers
cs.IT2018
The case for shifting the Renyi Entropy
Francisco José Valverde-Albacete, Carmen Peláez-Moreno
We introduce a variant of the Rényi entropy definition that aligns it with the well-known Hölder mean: in the new formulation, the r-th order Rényi Entropy is the logarithm of the…
cs.IT2017
Assessing Information Transmission in Data Transformations with the Channel Multivariate Entropy Triangle
Francisco J. Valverde-Albacete, Carmen Peláez-Moreno
Data transformation, e.g. feature transformation and selection, is an integral part of any machine learning procedure. In this paper we introduce an information-theoretic model and…
cs.IT2017
Entropy operates in non-linear semifields
Francisco J. Valverde-Albacete, Carmen Peláez-Moreno
We set out to demonstrate that the Rényi entropies with parameter are better thought of as operating in a type of non-linear semiring called a positive semifield. We show how t…