Hierarchical Clustering with Structural Constraints

Abstract

Hierarchical clustering is a popular unsupervised data analysis method. For many real-world applications, we would like to exploit prior information about the data that imposes constraints on the clustering hierarchy, and is not captured by the set of features available to the algorithm. This gives rise to the problem of "hierarchical clustering with structural constraints". Structural constraints pose major challenges for bottom-up approaches like average/single linkage and even though they can be naturally incorporated into top-down divisive algorithms, no formal guarantees exist on the quality of their output. In this paper, we provide provable approximation guarantees for two simple top-down algorithms, using a recently introduced optimization viewpoint of hierarchical clustering with pairwise similarity information [Dasgupta, 2016]. We show how to find good solutions even in the presence of conflicting prior information, by formulating a constraint-based regularization of the objective. We further explore a variation of this objective for dissimilarity information [Cohen-Addad et al., 2018] and improve upon current techniques. Finally, we demonstrate our approach on a real dataset for the taxonomy application.

In Proc. 35th International Conference on Machine Learning (ICML 2018)

References in corpus (1)

• Hierarchical Clustering via Spreading Metrics

Cited by in corpus (9)

• Deep Discriminative Clustering Analysis
• A Framework for Deep Constrained Clustering -- Algorithms and Advances
• Zeroth and First Order Stochastic Frank-Wolfe Algorithms for Constrained Optimization
• Parallel Approximate Maximum Flows in Near-Linear Work and Polylogarithmic Depth
• Clustering with Fast, Automated and Reproducible assessment applied to longitudinal neural tracking
• Exact and Approximate Hierarchical Clustering Using A*
• Constrained Hierarchical Clustering via Graph Coarsening and Optimal Cuts
• Hierarchical Clustering: New Bounds and Objective
• Inferring Hierarchical Mixture Structures: A Bayesian Nonparametric Approach