The suitability of h and g indexes for measuring the research performance of institutions. Scientometrics, 97(3), 555-570
arXiv:1810.12844 · doi:10.1007/s11192-013-1026-4
Abstract
It is becoming ever more common to use bibliometric indicators to evaluate the performance of research institutions, however there is often a failure to recognize the limits and drawbacks of such indicators. Since performance measurement is aimed at supporting critical decisions by research administrators and policy makers, it is essential to carry out empirical testing of the robustness of the indicators used. In this work we examine the accuracy of the popular "h" and "g" indexes for measuring university research performance by comparing the ranking lists derived from their application to the ranking list from a third indicator that better meets the requirements for robust and reliable assessment of institutional productivity. The test population is all Italian universities in the hard sciences, observed over the period 2001-2005. The analysis quantifies the correlations between the three university rankings (by discipline) and the shifts that occur under changing indicators, to measure the distortion inherent in use of the h and g indexes and their comparative accuracy for assessing institutions.
References in corpus (11)
- An index to quantify an individual's scientific research output
- Does the h-index have predictive power?
- Universality of citation distributions: towards an objective measure of scientific impact
- An index to quantify an individual's scientific research valid across disciplines
- A heuristic approach to author name disambiguation in bibliometrics databases for large-scale research assessments
- Testing bibliometric indicators by their prediction of scientists promotions
- Ranking forestry journals using the h-index
- National-scale research performance assessment at the individual level
- A sensitivity analysis of researchers' productivity rankings to the time of citation observation
- Assessing the accuracy of the h and g indexes for measuring researchers' productivity
- Measuring science: irresistible temptations, easy shortcuts and dangerous consequences