On the effectiveness of a binless entropy estimator for generalised entropic forms

Abstract

In this manuscript we discuss the effectiveness of the Kozachenko-Leonenko entropy estimator when generalised to cope with entropic forms customarily applied to study systems evincing asymptotic scale invariance and dependence (either linear or non-linear type). We show that when the variables are independently and identically distributed the estimator is only valuable along the whole domain if the data follow the uniform distribution, whereas for other distributions the estimator is only effectual in the limit of the Boltzmann-Gibbs-Shanon entropic form. We also analyse the influence of the dependence (linear and non-linear) between variables on the accuracy of the estimator between variables. As expected in the last case the estimator looses efficiency for the Boltzmann-Gibbs-Shanon entropic form as well.

10 pages. 5 Figures. 2 Appendices with 2 figures

References in corpus (5)

• Estimating Mutual Information
• Asymptotically scale-invariant occupancy of phase space makes the entropy Sq extensive
• Nonextensive statistical mechanics: A brief introduction
• On a generalised model for time-dependent variance with long-term memory
• On a comparative study between dependence scales determined by linear and non-linear measures