Some Properties of Rényi Entropy over Countably Infinite Alphabets
arXiv:1106.5130 · doi:10.1134/S0032946013020014
Abstract
In this paper we study certain properties of Rényi entropy functionals on the space of probability distributions over . Primarily, continuity and convergence issues are addressed. Some properties shown parallel those known in the finite alphabet case, while others illustrate a quite different behaviour of Rényi entropy in the infinite case. In particular, it is shown that, for any distribution and any , there exists a sequence of distributions converging to with respect to the total variation distance, such that .
arXiv comment13 pages (single-column)
References in corpus (6)
- Stability of Tsallis antropy and instabilities of Renyi and normalized Tsallis entropies: A basis for q-exponential distributions
- On observability of Renyi's entropy
- Coding on countably infinite alphabets
- Rényi Divergence and Majorization
- Universal Coding on Infinite Alphabets: Exponentially Decreasing Envelopes
- The world according to Renyi: Thermodynamics of multifractal systems