On Bayesian Mechanics: A Physics of and by Beliefs

Abstract

The aim of this paper is to introduce a field of study that has emerged over the last decade called Bayesian mechanics. Bayesian mechanics is a probabilistic mechanics, comprising tools that enable us to model systems endowed with a particular partition (i.e., into particles), where the internal states (or the trajectories of internal states) of a particular system encode the parameters of beliefs about external states (or their trajectories). These tools allow us to write down mechanical theories for systems that look as if they are estimating posterior probability distributions over the causes of their sensory states. This provides a formal language for modelling the constraints, forces, potentials, and other quantities determining the dynamics of such systems, especially as they entail dynamics on a space of beliefs (i.e., on a statistical manifold). Here, we will review the state of the art in the literature on the free energy principle, distinguishing between three ways in which Bayesian mechanics has been applied to particular systems (i.e., path-tracking, mode-tracking, and mode-matching). We go on to examine a duality between the free energy principle and the constrained maximum entropy principle, both of which lie at the heart of Bayesian mechanics, and discuss its implications.

50+7 pages, six figures. Invited contribution to "Making and Breaking Symmetries in Mind and Life," a special issue of the journal Royal Society Interface. First two authors have contributed equally

References in corpus (5)

• The thermodynamics of prediction
• Path integrals, particular kinds, and strange things
• Constructing Generalized Synchronization Manifolds by Manifold Equation
• Geometric Methods for Sampling, Optimisation, Inference and Adaptive Agents
• Sparse coupling and Markov blankets: A comment on "How particular is the physics of the Free Energy Principle?" by Aguilera, Millidge, Tschantz and Buckley

Cited by in corpus (9)

• Designing Ecosystems of Intelligence from First Principles
• The physical meaning of the holographic principle
• A variational synthesis of evolutionary and developmental dynamics
• The Free Energy Principle drives neuromorphic development
• Separability, Contextuality, and the Quantum Frame Problem
• A Worked Example of the Bayesian Mechanics of Classical Objects
• Self-orthogonalizing attractor neural networks emerging from the free energy principle
• A framework for the use of generative modelling in non-equilibrium statistical mechanics
• An entropic explanation of insistence on sameness in autism