Network-based statistical comparison of citation topology of bibliographic databases
arXiv:1502.05061 · doi:10.1038/srep06496
Abstract
Modern bibliographic databases provide the basis for scientific research and its evaluation. While their content and structure differ substantially, there exist only informal notions on their reliability. Here we compare the topological consistency of citation networks extracted from six popular bibliographic databases including Web of Science, CiteSeer and arXiv.org. The networks are assessed through a rich set of local and global graph statistics. We first reveal statistically significant inconsistencies between some of the databases with respect to individual statistics. For example, the introduced field bow-tie decomposition of DBLP Computer Science Bibliography substantially differs from the rest due to the coverage of the database, while the citation information within arXiv.org is the most exhaustive. Finally, we compare the databases over multiple graph statistics using the critical difference diagram. The citation topology of DBLP Computer Science Bibliography is the least consistent with the rest, while, not surprisingly, Web of Science is significantly more reliable from the perspective of consistency. This work can serve either as a reference for scholars in bibliometrics and scientometrics or a scientific evaluation guideline for governments and research agencies.
arXiv comment16 pages, 3 figures, 3 tables
References in corpus (19)
- Emergence of scaling in random networks
- Community structure in social and biological networks
- Power-law distributions in empirical data
- Assortative mixing in networks
- Hierarchical organization of modularity in metabolic networks
- Mixing patterns in networks
- Hierarchical Organization in Complex Networks
- Dynamical and correlation properties of the Internet
- Quantifying Long-Term Scientific Impact
- Universality of citation distributions: towards an objective measure of scientific impact
- Stretched exponential distributions in Nature and Economy: ``Fat tails'' with characteristic scales
- Citation Statistics from 110 Years of Physical Review
- Edge direction and the structure of networks
- Characterizing and modeling citation dynamics
- Nonuniversal power law scaling in the probability distribution of scientific citations
- Prediction of highly cited papers
- Universal fractal scaling of self-organized networks
- Ubiquitousness of link-density and link-pattern communities in real-world networks
- Node mixing and group structure of complex software networks