Estimating densities with nonlinear support using Fisher-Gaussian kernels
arXiv:1907.05918 · doi:10.1111/rssb.12390
Abstract
Current tools for multivariate density estimation struggle when the density is concentrated near a nonlinear subspace or manifold. Most approaches require choice of a kernel, with the multivariate Gaussian by far the most commonly used. Although heavy-tailed and skewed extensions have been proposed, such kernels cannot capture curvature in the support of the data. This leads to poor performance unless the sample size is very large relative to the dimension of the data. This article proposes a novel generalization of the Gaussian distribution, which includes an additional curvature parameter. We refer to the proposed class as Fisher-Gaussian (FG) kernels, since they arise by sampling from a von Mises-Fisher density on the sphere and adding Gaussian noise. The FG density has an analytic form, and is amenable to straightforward implementation within Bayesian mixture models using Markov chain Monte Carlo. We provide theory on large support, and illustrate gains relative to competitors in simulated and real data applications.
References in corpus (7)
- Natural Scales in Geographical Patterns
- Galaxy Zoo : Morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey
- Tutorial on Variational Autoencoders
- Galaxy Zoo 1 : Data Release of Morphological Classifications for nearly 900,000 galaxies
- Adaptive Bayesian multivariate density estimation with Dirichlet mixtures
- Kullback Leibler property of kernel mixture priors in Bayesian density estimation
- Identifying Mixtures of Mixtures Using Bayesian Estimation