Common probability patterns arise from simple invariances

Abstract

Shift and stretch invariance lead to the exponential-Boltzmann probability distribution. Rotational invariance generates the Gaussian distribution. Particular scaling relations transform the canonical exponential and Gaussian patterns into the variety of commonly observed patterns. The scaling relations themselves arise from the fundamental invariances of shift, stretch, and rotation, plus a few additional invariances. Prior work described the three fundamental invariances as a consequence of the equilibrium canonical ensemble of statistical mechanics or the Jaynesian maximization of information entropy. By contrast, I emphasize the primacy and sufficiency of invariance alone to explain the commonly observed patterns. Primary invariance naturally creates the array of commonly observed scaling relations and associated probability patterns, whereas the classical approaches derived from statistical mechanics or information theory require special assumptions to derive commonly observed scales.

arXiv commentFixed mistaken wording about shift invariance in introduction. Added new Appendix A with more details and discussion about related topics. Moved prior appendix to Appendix B. Other minor fixes and new references throughout

References in corpus (7)

• Superstatistics
• The common patterns of nature
• Generalized entropies and the transformation group of superstatistics
• A simple derivation and classification of common probability distributions based on information symmetry and measurement scale
• Measurement Invariance, Entropy, and Probability
• d'Alembert's direct and inertial forces acting on populations: the Price equation and the fundamental theorem of natural selection
• How to read probability distributions as statements about process

Cited by in corpus (6)

• The Price equation program: simple invariances unify population dynamics, thermodynamics, probability, information and inference
• Universal expressions of population change by the Price equation: natural selection, information, and maximum entropy production
• The fundamental equations of change in statistical ensembles and biological populations
• The common patterns of abundance: the log series and Zipf's law
• Invariant death
• The invariances of power law size distributions