Updating Probabilities

Abstract

We show that Skilling's method of induction leads to a unique general theory of inductive inference, the method of Maximum relative Entropy (ME). The main tool for updating probabilities is the logarithmic relative entropy; other entropies such as those of Renyi or Tsallis are ruled out. We also show that Bayes updating is a special case of ME updating and thus, that the two are completely compatible.

Presented at MaxEnt 2006, the 26th International Workshop on Bayesian Inference and Maximum Entropy Methods (July 8-13, 2006, Paris, France)

Cited by in corpus (63)

• Updating the Born rule
• Jacobi Fields on Statistical Manifolds of Negative Curvature
• Information geometric methods for complexity
• Fully Flexible Views: Theory and Practice
• Lectures on Probability, Entropy, and Statistical Physics
• Entropic Inference
• Entropy, Information, and the Updating of Probabilities
• The Effect Of Microscopic Correlations On The Information Geometric Complexity Of Gaussian Statistical Models
• From Physics to Economics: An Econometric Example Using Maximum Relative Entropy
• Quantifying The Complexity Of Geodesic Paths On Curved Statistical Manifolds Through Information Geometric Entropies and Jacobi Fields
• Entropic Dynamics: an Inference Approach to Quantum Theory, Time and Measurement
• Application of the Maximum relative Entropy method to the physics of ferromagnetic materials
• Applications of the divergence theorem in Bayesian inference and MaxEnt
• Entropic Updating of Probability and Density Matrices
• Quantum Measurement and Weak Values in Entropic Dynamics
• Information-Geometric Indicators of Chaos in Gaussian Models on Statistical Manifolds of Negative Ricci Curvature
• Continuity of the maximum-entropy inference: Convex geometry and numerical ranges approach
• Entropic dynamics on Gibbs statistical manifolds
• Information Geometric Modeling of Scattering Induced Quantum Entanglement
• Theoretical investigations of an information geometric approach to complexity
• Using Relative Entropy to Find Optimal Approximations: an Application to Simple Fluids
• Continuity of the Maximum-Entropy Inference
• Information Geometry and Chaos on Negatively Curved Statistical Manifolds
• Discretizing Distributions with Exact Moments: Error Estimate and Convergence Analysis
• Geometrodynamics of Information on Curved Statistical Manifolds and its Applications to Chaos
• Local softening of information geometric indicators of chaos in statistical modeling in the presence of quantum-like considerations
• Entropic Inference: some pitfalls and paradoxes we can avoid
• Generalized Galilean Transformations and the Measurement Problem in the Entropic Dynamics Approach to Quantum Theory
• On The Complexity Of Statistical Models Admitting Correlations
• Maximum Entropy: The Universal Method for Inference
• Computing Entropies With Nested Sampling
• DNest4: Diffusive Nested Sampling in C++ and Python
• Information Geometric Complexity of Entropic Motion on Curved Statistical Manifolds under Different Metrizations of Probability Spaces
• Maximum-entropy inference and inverse continuity of the numerical range
• A Bayesian interpretation of abrupt phase transitions
• Lüders' and quantum Jeffrey's rules as entropic projections
• Quantum theory as inductive inference
• Entropic Density Functional Theory
• Unification of some classical and quantum ideas
• The Inferential Design of Entropy and its Application to Quantum Measurements
• Quantum collapse rules from the maximum relative entropy principle
• Complexity Characterization in a Probabilistic Approach to Dynamical Systems Through Information Geometry and Inductive Inference
• Consensus between Epistemic Agents is Difficult
• The Design of Global Correlation Quantifiers and Continuous Notions of Statistical Sufficiency
• Why Simple Quadrature is just as good as Monte Carlo
• Information geometric complexity of entropic motion on curved statistical manifolds
• Ergodic statistical models: entropic dynamics and chaos
• Updating Probabilities: An Econometric Example
• Approximating the entire spectrum of nonequilibrium steady state distributions using relative entropy: An application to thermal conduction
• Discontinuities in the Maximum-Entropy Inference
• On principles of inductive inference
• Quantifying imperfect cognition via achieved information gain
• Categories of Brègman operations and epistemic (co)monads
• Embracing undecidability: Cognitive needs and theory evaluation
• The relativity of theory
• The Entropic Dynamics of Relativistic Quantum Fields in Curved Space-time
• Opinions and dark energy: A mechanism of long-range repulsion in a toy opinion particle model
• The Information Geometry of Chaos
• An information geometric perspective on the complexity of macroscopic predictions arising from incomplete information
• Updating Probabilities: A Complex Agent Based Example
• Legendre transformation and information geometry for the maximum entropy theory of ecology
• Softening the Complexity of Entropic Motion on Curved Statistical Manifolds
• Reexamination of an Information Geometric Construction of Entropic Indicators of Complexity