An Alternative Prior Process for Nonparametric Bayesian Clustering

Abstract

Prior distributions play a crucial role in Bayesian approaches to clustering. Two commonly-used prior distributions are the Dirichlet and Pitman-Yor processes. In this paper, we investigate the predictive probabilities that underlie these processes, and the implicit "rich-get-richer" characteristic of the resulting partitions. We explore an alternative prior for nonparametric Bayesian clustering -- the uniform process -- for applications where the "rich-get-richer" property is undesirable. We also explore the cost of this process: partitions are no longer exchangeable with respect to the ordering of variables. We present new asymptotic and simulation-based results for the clustering characteristics of the uniform process and compare these with known results for the Dirichlet and Pitman-Yor processes. We compare performance on a real document clustering task, demonstrating the practical advantage of the uniform process despite its lack of exchangeability over orderings.

References in corpus (1)

• Emergence of scaling in random networks

Cited by in corpus (10)

• Microclustering: When the Cluster Sizes Grow Sublinearly with the Size of the Data Set
• Flexible Models for Microclustering with Application to Entity Resolution
• Nonparametric Hierarchical Clustering of Functional Data
• Neural Clustering Processes
• Bayesian Hierarchical Clustering with Exponential Family: Small-Variance Asymptotics and Reducibility
• Powered Dirichlet Process for Controlling the Importance of "Rich-Get-Richer" Prior Assumptions in Bayesian Clustering
• Interactions in Information Spread
• A New Approach to Building the Interindustry Input--Output Table
• Semi- and Weakly-supervised Human Pose Estimation
• CODA: Constructivism Learning for Instance-Dependent Dropout Architecture Construction