9 citations · 19 across the 5 of their papers we have counts for
5 papers
A Concise Mathematical Description of Active Inference in Discrete Time
Jesse van Oostrum, Carlotta Langer, Nihat Ay
In this paper we present a concise mathematical description of active inference in discrete time. The main part of the paper serves as a basic introduction to the topic, including…
On the Natural Gradient of the Evidence Lower Bound
Nihat Ay, Jesse van Oostrum, Adwait Datar
This article studies the Fisher-Rao gradient, also referred to as the natural gradient, of the evidence lower bound (ELBO) which plays a central role in generative machine learning…
Inversion of Bayesian Networks
Jesse van Oostrum, Peter van Hintum, Nihat Ay
Variational autoencoders and Helmholtz machines use a recognition network (encoder) to approximate the posterior distribution of a generative model (decoder). In this paper we stud…
Invariance Properties of the Natural Gradient in Overparametrised Systems
Jesse van Oostrum, Johannes Müller, Nihat Ay
The natural gradient field is a vector field that lives on a model equipped with a distinguished Riemannian metric, e.g. the Fisher-Rao metric, and represents the direction of stee…
Bures-Wasserstein geometry for positive-definite Hermitian matrices and their trace-one subset
Jesse van Oostrum
In his classical argument, Rao derives the Riemannian distance corresponding to the Fisher metric using a mapping between the space of positive measures and Euclidean space. He obt…