On some entropy functionals derived from Rényi information divergence

Abstract

We consider the maximum entropy problems associated with Rényi $Q$-entropy, subject to two kinds of constraints on expected values. The constraints considered are a constraint on the standard expectation, and a constraint on the generalized expectation as encountered in nonextensive statistics. The optimum maximum entropy probability distributions, which can exhibit a power-law behaviour, are derived and characterized. The Rényi entropy of the optimum distributions can be viewed as a function of the constraint. This defines two families of entropy functionals in the space of possible expected values. General properties of these functionals, including nonnegativity, minimum, convexity, are documented. Their relationships as well as numerical aspects are also discussed. Finally, we work out some specific cases for the reference measure $Q(x)$ and recover in a limit case some well-known entropies.

References in corpus (2)

• Generalized statistical mechanics of cosmic rays
• On Equivalence of Thermostatistical Formalisms

Cited by in corpus (9)

• A simple probabilistic construction yielding generalized entropies and divergences, escort distributions and q-Gaussians
• On the entropic derivation of the $r^{-2}$ Newtonian gravity force
• Escort entropies and divergences and related canonical distribution
• Troublesome aspects of the Renyi-MaxEnt treatment
• Dimensional Regularization of Renyi's Statistical Mechanics
• Rescuing the MaxEnt treatment for $q$-generalized entropies
• Strong correlations between the exponent $\alpha$ and the particle number for a Renyi-monoatomic gas in Gibbs' statistical mechanics
• Testing Exponentiality Based on Rényi Entropy With Progressively Type-II Censored Data
• Reciprocity relations and generalized entropic quantifiers that lack trace-form