A short account of a connection of Power Laws to the Information Entropy

Abstract

We use the formalism of 'Maximum Principle of Shannon's Entropy' to derive the general power law distribution function, using what seems to be a reasonable physical assumption, namely, the demand of a constant mean "internal order" (Boltzmann Entropy) of a complex, self interacting, self organized system. Since the Shannon entropy is equivalent to the Boltzmann's entropy under equilibrium, non interacting conditions, we interpret this result as the complex system making use of its intra-interactions and its non equilibrium in order to keep the equilibrium Boltzmann's entropy constant on the average, thus enabling it an advantage at surviving over less ordered systems, i.e. hinting towards an "Evolution of Structure". We then demonstrate the formalism using a toy model to explain the power laws observed in Cities' populations and show how Zipf's law comes out as a natural special point of the model. We also suggest further directions of theory.

arXiv comment7 pages, no figures, accepted for publication in "Physica A"

References in corpus (1)

• Generalized Lotka-Volterra (GLV) Models and Generic Emergence of Scaling Laws in Stock Markets

Cited by in corpus (13)

• City Size Distributions For India and China
• Rank-frequency relation for Chinese characters
• Explaining Zipf's Law via Mental Lexicon
• Langevin processes, agent models and socio-economic systems
• Maximum entropy approach to power-law distributions in coupled dynamic-stochastic systems
• Measuring the Complexity of Continuous Distributions
• Two halves of a meaningful text are statistically different
• On the Perturbation of Self-Organized Urban Street Networks
• Stochastic model for phonemes uncovers an author-dependency of their usage
• Structure Entropy, Self-Organization, and Power Laws in Urban Street Networks: Evidence for Alexander's Ideas
• On Equilibrium Metropolis Simulations on Self-Organized Urban Street Networks
• Complex distributions emerging in filtering and compression
• On the Statistics of Urban Street Networks