Clustering scientific publications based on citation relations: A systematic comparison of different methods
arXiv:1512.09023 · doi:10.1371/journal.pone.0154404
Abstract
Clustering methods are applied regularly in the bibliometric literature to identify research areas or scientific fields. These methods are for instance used to group publications into clusters based on their relations in a citation network. In the network science literature, many clustering methods, often referred to as graph partitioning or community detection techniques, have been developed. Focusing on the problem of clustering the publications in a citation network, we present a systematic comparison of the performance of a large number of these clustering methods. Using a number of different citation networks, some of them relatively small and others very large, we extensively study the statistical properties of the results provided by different methods. In addition, we also carry out an expert-based assessment of the results produced by different methods. The expert-based assessment focuses on publications in the field of scientometrics. Our findings seem to indicate that there is a trade-off between different properties that may be considered desirable for a good clustering of publications. Overall, map equation methods appear to perform best in our analysis, suggesting that these methods deserve more attention from the bibliometric community.
24 pages, 7 figures, 7 tables
References in corpus (21)
- Fast unfolding of communities in large networks
- Modularity and community structure in networks
- Maps of random walks on complex networks reveal community structure
- Near linear time algorithm to detect community structures in large-scale networks
- Benchmark graphs for testing community detection algorithms
- Resolution limit in community detection
- Statistical Mechanics of Community Detection
- Stochastic blockmodels and community structure in networks
- Finding statistically significant communities in networks
- Benchmarks for testing community detection algorithms on directed and weighted graphs with overlapping communities
- An information-theoretic framework for resolving community structure in complex networks
- Multilevel compression of random walks on networks reveals hierarchical organization in large integrated systems
- Narrow scope for resolution-limit-free community detection
- Robustness of community structure in networks
- Community detection in networks: Structural communities versus ground truth
- A sequential algorithm for fast clique percolation
- Unfolding communities in large complex networks: Combining defensive and offensive label propagation for core extraction
- Robust network community detection using balanced propagation
- Model selection and hypothesis testing for large-scale network models with overlapping groups
- Evaluation of the citation matching algorithms of CWTS and iFQ in comparison to Web of Science
- Resampling effects on significance analysis of network clustering and ranking
Cited by in corpus (18)
- Men Set Their Own Cites High: Gender and Self-citation across Fields and over Time
- Practical method to reclassify Web of Science articles into unique subject categories and broad disciplines
- Granularity of algorithmically constructed publication-level classifications of research publications: Identification of topics
- Granularity of algorithmically constructed publication-level classifications of research publications: Identification of specialties
- Randomizing growing networks with a time-respecting null model
- Center-Periphery Structure in Communities: Extracellular Vesicles
- Label propagation for clustering
- Viewing Computer Science through Citation Analysis; Salton and Bergmark Redux
- Recategorising research: Mapping from FoR 2008 to FoR 2020 in Dimensions
- Algorithmic labeling in hierarchical classifications of publications: Evaluation of bibliographic fields and term weighting approaches
- Convexity in complex networks
- Do Mathematicians, Economists and Biomedical Scientists Trace Large Topics More Strongly Than Physicists?
- Finding Scientific Communities In Citation Graphs: Convergent Clustering
- Improving overlay maps of science: combining overview and detail
- Citation-based clustering of publications using CitNetExplorer and VOSviewer
- New paper-by-paper classification for Scopus based on references reclassified by the origin of the papers citing them
- Using language models to label clusters of scientific documents
- How to interpret algorithmically constructed topical structures of research specialties? A case study comparing an internal and an external mapping of the topical structure of invasion biology