Scalable Text and Link Analysis with Mixed-Topic Link Models

Abstract

Many data sets contain rich information about objects, as well as pairwise relations between them. For instance, in networks of websites, scientific papers, and other documents, each node has content consisting of a collection of words, as well as hyperlinks or citations to other nodes. In order to perform inference on such data sets, and make predictions and recommendations, it is useful to have models that are able to capture the processes which generate the text at each node and the links between them. In this paper, we combine classic ideas in topic modeling with a variant of the mixed-membership block model recently developed in the statistical physics community. The resulting model has the advantage that its parameters, including the mixture of topics of each document and the resulting overlapping communities, can be inferred with a simple and scalable expectation-maximization algorithm. We test our model on three data sets, performing unsupervised topic classification and link prediction. For both tasks, our model outperforms several existing state-of-the-art methods, achieving higher accuracy with significantly less computation, analyzing a data set with 1.3 million words and 44 thousand links in a few minutes.

11 pages, 4 figures

References in corpus (6)

• Hierarchical structure and the prediction of missing links in networks
• Stochastic blockmodels and community structure in networks
• Asymptotic analysis of the stochastic block model for modular networks and its algorithmic applications
• Mixture models and exploratory analysis in networks
• Phase transition in the detection of modules in sparse networks
• A Bayesian Framework for Community Detection Integrating Content and Link

Cited by in corpus (11)

• Classifying Patents Based on their Semantic Content
• Bibliographic Analysis with the Citation Network Topic Model
• Latent Space Model for Multi-Modal Social Data
• Bibliographic Analysis on Research Publications using Authors, Categorical Labels and the Citation Network
• Multilayer Networks for Text Analysis with Multiple Data Types
• Topic-adjusted visibility metric for scientific articles
• Evaluating the effect of topic consideration in identifying communities of rating-based social networks
• Community Specific Temporal Topic Discovery from Social Media
• The Concept of Decentralization Through Time and Disciplines: A Quantitative Exploration
• Stochastic Blockmodels with Edge Information
• From Community Detection to Community Profiling