Conjugacy properties of time-evolving Dirichlet and gamma random measures

Abstract

We extend classic characterisations of posterior distributions under Dirichlet process and gamma random measures priors to a dynamic framework. We consider the problem of learning, from indirect observations, two families of time-dependent processes of interest in Bayesian nonparametrics: the first is a dependent Dirichlet process driven by a Fleming-Viot model, and the data are random samples from the process state at discrete times; the second is a collection of dependent gamma random measures driven by a Dawson-Watanabe model, and the data are collected according to a Poisson point process with intensity given by the process state at discrete times. Both driving processes are diffusions taking values in the space of discrete measures whose support varies with time, and are stationary and reversible with respect to Dirichlet and gamma priors respectively. A common methodology is developed to obtain in closed form the time-marginal posteriors given past and present data. These are shown to belong to classes of finite mixtures of Dirichlet processes and gamma random measures for the two models respectively, yielding conjugacy of these classes to the type of data we consider. We provide explicit results on the parameters of the mixture components and on the mixing weights, which are time-varying and drive the mixtures towards the respective priors in absence of further data. Explicit algorithms are provided to recursively compute the parameters of the mixtures. Our results are based on the projective properties of the signals and on certain duality properties of their projections.

arXiv commentTo appear on the Electronic Journal of Statistics. arXiv admin note: text overlap with arXiv:1411.4944

References in corpus (8)

• Bayesian Inference for Linear Dynamic Models with Dirichlet Process Mixtures
• Generalized Polya Urn for Time-varying Dirichlet Process Mixtures
• Optimal filtering and the dual process
• Introductory Lectures on Stochastic Population Systems
• Dynamic density estimation with diffusive Dirichlet mixtures
• A Fleming--Viot process and Bayesian nonparametrics
• Bayesian nonparametric models for ranked data
• Canonical correlations for dependent gamma processes

Cited by in corpus (6)

• Smoothing distributions for conditional Fleming-Viot and Dawson-Watanabe diffusions
• Approximate filtering via discrete dual processes
• An R package for nonparametric inference on dynamic populations with infinitely many types
• Dual process in the two-parameter Poisson-Dirichlet diffusion
• Clustering dynamics in a class of normalised generalised gamma dependent priors
• Filtering coupled Wright-Fisher diffusions