Information Theory based on Non-additive Information Content

Abstract

We generalize the Shannon's information theory in a nonadditive way by focusing on the source coding theorem. The nonadditive information content we adopted is consistent with the concept of the form invariance structure of the nonextensive entropy. Some general properties of the nonadditive information entropy are studied, in addition, the relation between the nonadditivity $q$ and the codeword length is pointed out.

9 pages, no figures, RevTex, accepted for publication in Phys. Rev. E(an error in proof of theorem 1 was corrected, typos corrected)

References in corpus (2)

• Axioms and uniqueness theorem for Tsallis entropy
• Nonadditive conditional entropy and its significance for local realism

Cited by in corpus (12)

• Information theoretical properties of Tsallis entropies
• Source coding with escort distributions and Renyi entropy bounds
• Nonadditive measure and quantum entanglement in a class of mixed states of N^n-system
• Nonextensive Entropies derived from Form Invariance of Pseudoadditivity
• Quantum Correlation with Sandwiched Relative Entropies: Advantageous as Order Parameter in Quantum Phase Transitions
• Generalized bit- moments and cumulants based on discrete derivative
• Dissipative quantum theory: Implications for quantum entanglement
• Generalized Statistics Framework for Rate Distortion Theory with Bregman Divergences
• Classical and Nonextensive Information Theory
• Long-range medical image registration through generalized mutual information (GMI): toward a fully automatic volumetric alignment
• Deformed Statistics Formulation of the Information Bottleneck Method
• Generalized Statistics Framework for Rate Distortion Theory