Self-Taught Convolutional Neural Networks for Short Text Clustering

Abstract

Short text clustering is a challenging problem due to its sparseness of text representation. Here we propose a flexible Self-Taught Convolutional neural network framework for Short Text Clustering (dubbed STC^2), which can flexibly and successfully incorporate more useful semantic features and learn non-biased deep text representation in an unsupervised manner. In our framework, the original raw text features are firstly embedded into compact binary codes by using one existing unsupervised dimensionality reduction methods. Then, word embeddings are explored and fed into convolutional neural networks to learn deep feature representations, meanwhile the output units are used to fit the pre-trained binary codes in the training process. Finally, we get the optimal clusters by employing K-means to cluster the learned representations. Extensive experimental results demonstrate that the proposed framework is effective, flexible and outperform several popular clustering methods when tested on three public short text datasets.

33 pages, accepted for publication in Neural Networks

References in corpus (7)

• Efficient Estimation of Word Representations in Vector Space
• Distributed Representations of Words and Phrases and their Compositionality
• Sequence to Sequence Learning with Neural Networks
• Natural Language Processing (almost) from Scratch
• Distributed Representations of Sentences and Documents
• ReNet: A Recurrent Neural Network Based Alternative to Convolutional Networks
• Ensemble of Generative and Discriminative Techniques for Sentiment Analysis of Movie Reviews

Cited by in corpus (10)

• Twin Contrastive Learning for Online Clustering
• Extracting Sentence Embeddings from Pretrained Transformer Models
• Supporting Clustering with Contrastive Learning
• A Query-Driven Topic Model
• Quantum enhanced cross-validation for near-optimal neural networks architecture selection
• Multi-Perspective Abstractive Answer Summarization
• Attentive Representation Learning with Adversarial Training for Short Text Clustering
• CEIL: A General Classification-Enhanced Iterative Learning Framework for Text Clustering
• Pairwise Supervised Contrastive Learning of Sentence Representations
• Deep Clustering with Measure Propagation