A categorical foundation for Bayesian probability

Abstract

Given two measurable spaces $H$ and $D$ with countably generated $\sigma$-algebras, a perfect prior probability measure $P_H$ on $H$ and a sampling distribution $S:H\to D$, there is a corresponding inference map $I:D\to H$ which is unique up to a set of measure zero. Thus, given a data measurement $\mu :1\to D$, a posterior probability $\widehat{P_H}=I\circ \mu$ can be computed. This procedure is iterative: with each updated probability $P_H$, we obtain a new joint distribution which in turn yields a new inference map $I$ and the process repeats with each additional measurement. The main result uses an existence theorem for regular conditional probabilities by Faden, which holds in more generality than the setting of Polish spaces. This less stringent setting then allows for non-trivial decision rules (Eilenberg--Moore algebras) on finite (as well as non finite) spaces, and also provides for a common framework for decision theory and Bayesian probability.

15 pages; revised setting to more clearly explain how to incorporate perfect measures and the Giry monad; to appear in Applied Categorical Structures

Cited by in corpus (7)

• Disintegration and Bayesian Inversion via String Diagrams
• A free energy principle for generic quantum systems
• A non-commutative Bayes' theorem
• State retrieval beyond Bayes' retrodiction
• Categorical Stochastic Processes and Likelihood
• Conditional Distributions for Quantum Systems
• The Right Angled Artin Group Functor as a Categorical Embedding