Correlated Random Measures
arXiv:1507.00720
Abstract
We develop correlated random measures, random measures where the atom weights can exhibit a flexible pattern of dependence, and use them to develop powerful hierarchical Bayesian nonparametric models. Hierarchical Bayesian nonparametric models are usually built from completely random measures, a Poisson-process based construction in which the atom weights are independent. Completely random measures imply strong independence assumptions in the corresponding hierarchical model, and these assumptions are often misplaced in real-world settings. Correlated random measures address this limitation. They model correlation within the measure by using a Gaussian process in concert with the Poisson process. With correlated random measures, for example, we can develop a latent feature model for which we can infer both the properties of the latent features and their dependency pattern. We develop several other examples as well. We study a correlated random measure model of pairwise count data. We derive an efficient variational inference algorithm and show improved predictive performance on large data sets of documents, web clicks, and electronic health records.
References in corpus (8)
- Spike and slab variable selection: Frequentist and Bayesian strategies
- Nested Hierarchical Dirichlet Processes
- Beta-Negative Binomial Process and Poisson Factor Analysis
- Variational inference for large-scale models of discrete choice
- Student-t Processes as Alternatives to Gaussian Processes
- Correlated Non-Parametric Latent Feature Models
- Compound random measures and their use in Bayesian nonparametrics
- Modeling for Dynamic Ordinal Regression Relationships: An Application to Estimating Maturity of Rockfish in California