Deep Continuous Clustering

Abstract

Clustering high-dimensional datasets is hard because interpoint distances become less informative in high-dimensional spaces. We present a clustering algorithm that performs nonlinear dimensionality reduction and clustering jointly. The data is embedded into a lower-dimensional space by a deep autoencoder. The autoencoder is optimized as part of the clustering process. The resulting network produces clustered data. The presented approach does not rely on prior knowledge of the number of ground-truth clusters. Joint nonlinear dimensionality reduction and clustering are formulated as optimization of a global continuous objective. We thus avoid discrete reconfigurations of the objective that characterize prior clustering algorithms. Experiments on datasets from multiple domains demonstrate that the presented algorithm outperforms state-of-the-art clustering schemes, including recent methods that use deep networks.

arXiv commentThe code is available at http://github.com/shahsohil/DCC

References in corpus (4)

• Towards K-means-friendly Spaces: Simultaneous Deep Learning and Clustering
• Joint Unsupervised Learning of Deep Representations and Image Clusters
• Deep Clustering via Joint Convolutional Autoencoder Embedding and Relative Entropy Minimization
• Graph Degree Linkage: Agglomerative Clustering on a Directed Graph

Cited by in corpus (13)

• Machine Learning for Intrusion Detection in Industrial Control Systems: Applications, Challenges, and Recommendations
• AutoEmbedder: A semi-supervised DNN embedding system for clustering
• Deep Discriminative Clustering Analysis
• Machine Learning for Reliability Engineering and Safety Applications: Review of Current Status and Future Opportunities
• Online Deterministic Annealing for Classification and Clustering
• Efficient Parameter-free Clustering Using First Neighbor Relations
• Elastic-InfoGAN: Unsupervised Disentangled Representation Learning in Class-Imbalanced Data
• Deep Discriminative Latent Space for Clustering
• Deep Density-based Image Clustering
• Deep Fair Discriminative Clustering
• Multi-level Feature Learning on Embedding Layer of Convolutional Autoencoders and Deep Inverse Feature Learning for Image Clustering
• Deep Embedded K-Means Clustering
• From Time Series to Euclidean Spaces: On Spatial Transformations for Temporal Clustering