Maximum Entropy Principle in statistical inference: case for non-Shannonian entropies
arXiv:1808.01172 · doi:10.1103/PhysRevLett.122.120601
Abstract
In this letter we show that the Shore--Johnson axioms for Maximum Entropy Principle in statistical estimation theory account for a considerably wider class of entropic functional than previously thought. Apart from a formal side of the proof, we substantiate our point by analyzing the effect of weak correlations and discuss two pertinent examples: -qubit quantum system and strongly interacting nuclear systems.
arXiv commentto appear in Phys. Rev. Lett., 6 pages, 6 pages of Supplementary material
References in corpus (31)
- Event-by-Event Fluctuations in Heavy Ion Collisions and the QCD Critical Point
- Interpretation of the nonextensitivity parameter in some applications of Tsallis statistics and Lévy distributions
- Mid-Rapidity Neutral Pion Production in Proton-Proto Collisions at sqrt(s_NN) = 200 GeV
- Measurement of pion, kaon and proton production in proton-proton collisions at TeV
- When do generalized entropies apply? How phase space volume determines entropy
- Long-term Evolution of Stellar Self-Gravitating System away from the Thermal Equilibrium: connection with non-extensive statistics
- Group entropies, correlation laws and zeta functions
- Zeroth Law compatibility of non-additive thermodynamics
- Identified hadron compositions in p+p and Au+Au collisions at high transverse momenta at GeV
- Neutral pion production at midrapidity in pp and Pb-Pb collisions at = 2.76 TeV
- Multiplicity fluctuations due to the temperature fluctuations in high-energy nuclear collisions
- Generalized non-additive entropies and quantum entanglement
- Non-extensive Boltzmann Equation and Hadronization
- Nonadditive Entropies Yield Probability Distributions with Biases not Warranted by the Data
- Systematic Analysis of the Non-extensive Statistical Approach in High Energy Particle Collisions - Experiment vs. Theory
- How multiplicity determines entropy and the derivation of the maximum entropy principle for complex systems
- Family of additive entropy functions out of thermodynamic limit
- Transverse momentum fluctuations due to temperature variation in high-energy nuclear collisions
- Generalized Additivity in Unitary Conformal Field Theories
- Towards a relativistic statistical theory
- Generalized Shannon-Khinchin Axioms and Uniqueness Theorem for Pseudo-additive Entropies
- Unidirectional Random Growth with Resetting
- Generalized statistics: yet another generalization
- On q-non-extensive statistics with non-Tsallisian entropy
- Classification of complex systems by their sample-space scaling exponents
- One-parameter class of uncertainty relations based on entropy power
- Tsallis thermostatics as a statistical physics of random chains
- Conceptual Inadequacy of the Shore and Johnson Axioms for Wide Classes of Complex Systems
- Escort entropies and divergences and related canonical distribution
- The world according to Renyi: Thermodynamics of multifractal systems
- Entropies for complex systems: generalized-generalized entropies
Cited by in corpus (38)
- Superstatistical approach to air pollution statistics
- Tsallis cosmology and its applications in dark matter physics with focus on IceCube high-energy neutrino data
- Entropy, Information, and the Updating of Probabilities
- An overview of generalized entropic forms
- When Shannon and Khinchin meet Shore and Johnson: equivalence of information theory and statistical inference axiomatics
- Tsallis meets Boltzmann: q-index for a finite ideal gas and its thermodynamic limit
- Coherent states for generalized uncertainty relations as Tsallis probability amplitudes: new route to non-extensive thermostatistics
- Gradient and GENERIC evolution towards reduced dynamics
- Multivariate Group Entropies, Super-exponentially Growing Complex Systems and Functional Equations
- A generalization of the maximum entropy principle for curved statistical manifolds
- Affinity-based extension of non-extensive entropy and statistical mechanics
- Thermodynamics of exponential Kolmogorov-Nagumo averages
- The Theory of Thermodynamic Relativity
- Thermodynamics from first principles: correlations and nonextensivity
- Universal properties of primary and secondary cosmic ray energy spectra
- Information geometry of scaling expansions of non-exponentially growing configuration spaces
- Approaching a large deviation theory for complex systems
- Stochastic thermodynamics and fluctuation theorems for non-linear systems
- Generalizing Information to the Evolution of Rational Belief
- Permutation group entropy: a new route to complexity for real-valued processes
- On the equivalence between four versions of thermostatistics based on strongly pseudo-additive entropies
- An Information Theoretic Exploration of Constrained MSSM
- From Rényi Entropy Power to Information Scan of Quantum States
- The Tsallis entropy and the BKT-like phase transition in the impact parameter space for and collisions
- Thermodynamics of structure-forming systems
- Dimensional measures of generalized entropy
- Reply to "Comment on `Rényi entropy yields artificial biases not in the data and incorrect updating due to the finite-size data' "
- Comment on "Rényi entropy yields artifficial biases not in the data and incorrect updating due to the infinite-size data"
- Information Shift Dynamics Described by Tsallis Entropy on a Compact Phase Space
- Learn your entropy from informative data: an axiom ensuring the consistent identification of generalized entropies
- Geometric Structures Induced by Deformations of the Legendre Transform
- Spatial analysis of tails of air pollution PDFs in Europe
- Disentangling quantum neural networks for unified estimation of quantum entropies and distance measures
- Decoherence limit of quantum systems obeying generalized uncertainty principle: new paradigm for Tsallis thermostatistics
- Causal inference in time series in terms of Rényi transfer entropy
- Three invariants of strange attractors derived through hypergeometric entropy
- Kappa distributions in the framework of superstatistics
- On the estimating equations and objective functions for parameters of exponential power distribution: Application for disorder