Geometric Methods for Sampling, Optimisation, Inference and Adaptive Agents

Abstract

In this chapter, we identify fundamental geometric structures that underlie the problems of sampling, optimisation, inference and adaptive decision-making. Based on this identification, we derive algorithms that exploit these geometric structures to solve these problems efficiently. We show that a wide range of geometric theories emerge naturally in these fields, ranging from measure-preserving processes, information divergences, Poisson geometry, and geometric integration. Specifically, we explain how (i) leveraging the symplectic geometry of Hamiltonian systems enable us to construct (accelerated) sampling and optimisation methods, (ii) the theory of Hilbertian subspaces and Stein operators provides a general methodology to obtain robust estimators, (iii) preserving the information geometry of decision-making yields adaptive agents that perform active inference. Throughout, we emphasise the rich connections between these fields; e.g., inference draws on sampling and optimisation, and adaptive decision-making assesses decisions by inferring their counterfactual consequences. Our exposition provides a conceptual overview of underlying ideas, rather than a technical discussion, which can be found in the references herein.

30 pages, 4 figures; 42 pages including table of contents and references

References in corpus (9)

• Training generative neural networks via Maximum Mean Discrepancy optimization
• Accelerating diffusions
• Universality, Characteristic Kernels and RKHS Embedding of Measures
• Irreversible Langevin samplers and variance reduction: a large deviation approach
• Active Inference in Robotics and Artificial Agents: Survey and Challenges
• Information-geometric Markov Chain Monte Carlo methods using Diffusions
• Statistical Inference for Generative Models with Maximum Mean Discrepancy
• Introducing an Explicit Symplectic Integration Scheme for Riemannian Manifold Hamiltonian Monte Carlo
• Control as Hybrid Inference

Cited by in corpus (2)

• On Bayesian Mechanics: A Physics of and by Beliefs
• A Worked Example of the Bayesian Mechanics of Classical Objects