Are there too many uncited articles? Zero inflated variants of the discretised lognormal and hooked power law distributions
arXiv:1604.06246 · doi:10.1016/j.joi.2016.04.014
Abstract
Although statistical models fit many citation data sets reasonably well with the best fitting models being the hooked power law and discretised lognormal distribution, the fits are rarely close. One possible reason is that there might be more uncited articles than would be predicted by any model if some articles are inherently uncitable. Using data from 23 different Scopus categories, this article tests the assumption that removing a proportion of uncited articles from a citation dataset allows statistical distributions to have much closer fits. It also introduces two new models, zero inflated discretised lognormal distribution and the zero inflated hooked power law distribution and algorithms to fit them. In all 23 cases, the zero inflated version of the discretised lognormal distribution was an improvement on the standard version and in 15 out of 23 cases the zero inflated version of the hooked power law was an improvement on the standard version. Without zero inflation the discretised lognormal models fit the data better than the hooked power law distribution 6 out of 23 times and with it, the discretised lognormal models fit the data better than the hooked power law distribution 9 out of 23 times. Apparently uncitable articles seem to occur due to the presence of academic-related magazines in Scopus categories. In conclusion, future citation analysis and research indicators should take into account uncitable articles, and the best fitting distribution for sets of citation counts from a single subject and year is either the zero inflated discretised lognormal or zero inflated hooked power law.
arXiv commentThelwall, M. (in press) Journal of Informetrics. Software and data available here: https://dx.doi.org/10.6084/m9.figshare.3186997.v1
References in corpus (12)
- How Popular is Your Paper? An Empirical Study of the Citation Distribution
- Universality of citation distributions: towards an objective measure of scientific impact
- Characterizing and modeling citation dynamics
- On the calculation of percentile-based bibliometric indicators
- Fitting heavy tailed distributions: the poweRlaw package
- Assessing the varying level of impact measurement accuracy as a function of the citation window length
- An exploratory study of Google Scholar
- The discretised lognormal and hooked power law distributions for complete citation data: Best options for modelling and regression
- Geometric journal impact factors correcting for individual highly cited articles
- The precision of the arithmetic mean, geometric mean and percentiles for citation data: An experimental simulation modelling approach
- Distributions for cited articles from individual subjects and years
- Citation distribution of individual scientist: approximations of stretch exponential distribution with power law tails
Cited by in corpus (5)
- Three practical field normalised alternative indicator formulae for research evaluation
- The Accuracy of Confidence Intervals for Field Normalised Indicators
- Is OpenAlex Suitable for Research Quality Evaluation and Which Citation Indicator is Best?
- Do 'altmetric mentions' follow Power Laws? Evidence from social media mention data in Altmetric.com
- Uncertain research country rankings. Should we continue producing uncertain rankings?