Source coding with escort distributions and Renyi entropy bounds

Abstract

We discuss the interest of escort distributions and Rényi entropy in the context of source coding. We first recall a source coding theorem by Campbell relating a generalized measure of length to the Rényi-Tsallis entropy. We show that the associated optimal codes can be obtained using considerations on escort-distributions. We propose a new family of measure of length involving escort-distributions and we show that these generalized lengths are also bounded below by the Rényi entropy. Furthermore, we obtain that the standard Shannon codes lengths are optimum for the new generalized lengths measures, whatever the entropic index. Finally, we show that there exists in this setting an interplay between standard and escort distributions.

References in corpus (1)

• The world according to Renyi: Thermodynamics of multifractal systems

Cited by in corpus (10)

• Renyi's information transfer between financial time series
• Transfer entropy between communities in complex networks
• A simple probabilistic construction yielding generalized entropies and divergences, escort distributions and q-Gaussians
• On a generalized entropic uncertainty relation in the case of the qubit
• Rényi Entropy Power Inequalities via Normal Transport and Rotation
• On Generalized Stam Inequalities and Fisher-Rényi Complexity Measures
• Differential-escort transformations and the monotonicity of the LMC-Rényi complexity measure
• From Rényi Entropy Power to Information Scan of Quantum States
• On nonlinear compression costs: when Shannon meets Rényi
• Rényi Entropy Power and Normal Transport