The inconsistency of h-index: a mathematical analysis
arXiv:2002.06974 · doi:10.1016/j.joi.2020.101106
Abstract
Citation distributions are lognormal. We use 30 lognormally distributed synthetic series of numbers that simulate real series of citations to investigate the consistency of the h index. Using the lognormal cumulative distribution function, the equation that defines the h index can be formulated; this equation shows that h has a complex dependence on the number of papers (N). We also investigate the correlation between h and the number of papers exceeding various citation thresholds, from 5 to 500 citations. The best correlation is for the 100 threshold but numerous data points deviate from the general trend. The size-independent indicator h/N shows no correlation with the probability of publishing a paper exceeding any of the citation thresholds. In contrast with the h index, the total number of citations shows a high correlation with the number of papers exceeding the thresholds of 10 and 50 citations; the mean number of citations correlates with the probability of publishing a paper that exceeds any level of citations. Thus, in synthetic series, the number of citations and the mean number of citations are much better indicators of research performance than h and h/N. We discuss that in real citation distributions there are other difficulties.
arXiv comment27 pages, 1 table and 6 figures in one PDF file, second version
References in corpus (16)
- An index to quantify an individual's scientific research output
- Universality of citation distributions: towards an objective measure of scientific impact
- Defining and identifying Sleeping Beauties in science
- Citation Statistics from 110 Years of Physical Review
- How do you define and measure research productivity?
- Regression for citation data: An evaluation of different methods
- Systematic analysis of agreement between metrics and peer review in the UK REF
- The precision of the arithmetic mean, geometric mean and percentiles for citation data: An experimental simulation modelling approach
- Heuristics as conceptual lens for understanding and studying the usage of bibliometrics in research evaluation
- Universality of Performance Indicators based on Citation and Reference Counts
- Distributions for cited articles from individual subjects and years
- A Case Study of the Arbitrariness of the h-Index and the Highly-Cited-Publications Indicator
- Citation count distributions for large monodisciplinary journals
- Research assessment by percentile-based double rank analysis
- Like-for-like bibliometric substitutes for peer review: advantages and limits of indicators calculated from the ep index
- Not dead, just resting: The practical value of per publication citation indicators