A simple probabilistic construction yielding generalized entropies and divergences, escort distributions and q-Gaussians
arXiv:1206.0561 · doi:10.1016/j.physa.2012.04.024
Abstract
We give a simple probabilistic description of a transition between two states which leads to a generalized escort distribution. When the parameter of the distribution varies, it defines a parametric curve that we call an escort-path. The Rényi divergence appears as a natural by-product of the setting. We study the dynamics of the Fisher information on this path, and show in particular that the thermodynamic divergence is proportional to Jeffreys' divergence. Next, we consider the problem of inferring a distribution on the escort-path, subject to generalized moments constraints. We show that our setting naturally induces a rationale for the minimization of the Rényi information divergence. Then, we derive the optimum distribution as a generalized q-Gaussian distribution.
References in corpus (12)
- Dissipation: The phase-space perspective
- Measuring thermodynamic length
- Entropy production and the arrow of time
- Anomalous diffusion and Tsallis statistics in an optical lattice
- Geometry of escort distributions
- Source coding with escort distributions and Renyi entropy bounds
- Escort mean values and the characterization of power-law-decaying probability densities
- q-Gaussians in the porous-medium equation: stability and time evolution
- On some entropy functionals derived from Rényi information divergence
- Escort--Husimi distributions, Fisher information and nonextensivity
- Escort entropies and divergences and related canonical distribution
- Information Geometry of q-Gaussian Densities and Behaviors of Solutions to Related Diffusion Equations
Cited by in corpus (9)
- On Statistical Properties of Jizba-Arimitsu Hybrid Entropy
- Rescaling the nonadditivity parameter in Tsallis thermostatistics
- Information geometric duality of -deformed exponential families
- Differential-escort transformations and the monotonicity of the LMC-Rényi complexity measure
- Pairwise interactions origin of entropy functions
- Variational Representations of Annealing Paths: Bregman Information under Monotonic Embedding
- Chaining Meets Chain Rule: Multilevel Entropic Regularization and Training of Neural Nets
- On the estimating equations and objective functions for parameters of exponential power distribution: Application for disorder
- Maximum Multiscale Entropy and Neural Network Regularization