The h-index is no longer an effective correlate of scientific reputation
arXiv:2102.03234 · doi:10.1371/journal.pone.0253397
Abstract
The impact of individual scientists is commonly quantified using citation-based measures. The most common such measure is the h-index. A scientist's h-index affects hiring, promotion, and funding decisions, and thus shapes the progress of science. Here we report a large-scale study of scientometric measures, analyzing millions of articles and hundreds of millions of citations across four scientific fields and two data platforms. We find that the correlation of the h-index with awards that indicate recognition by the scientific community has substantially declined. These trends are associated with changing authorship patterns. We show that these declines can be mitigated by fractional allocation of citations among authors, which has been discussed in the literature but not implemented at scale. We find that a fractional analogue of the h-index outperforms other measures as a correlate and predictor of scientific awards. Our results suggest that the use of the h-index in ranking scientists should be reconsidered, and that fractional allocation measures such as h-frac provide more robust alternatives. An interactive visualization of our work can be found at https://h-frac.org
arXiv commentAn interactive visualization of our work can be found at https://h-frac.org
References in corpus (10)
- An index to quantify an individual's scientific research output
- Does the h-index have predictive power?
- Universality of citation distributions: towards an objective measure of scientific impact
- An index to quantify an individual's scientific research valid across disciplines
- An index to quantify an individual's scientific research output that takes into account the effect of multiple coauthorship
- Principles of scientific research team formation and evolution
- On the Predictability of Future Impact in Science
- The w-index: A significant improvement of the h-index
- Analysis of bibliometric indicators for individual scholars in a large data set
- Assessing scientific research performance and impact with single indices