Citations versus journal impact factor as proxy of quality: Could the latter ever be preferable?
arXiv:1811.01803 · doi:10.1007/s11192-010-0200-1
Abstract
In recent years bibliometricians have paid increasing attention to research evaluation methodological problems, among these being the choice of the most appropriate indicators for evaluating quality of scientific publications, and thus for evaluating the work of single scientists, research groups and entire organizations. Much literature has been devoted to analyzing the robustness of various indicators, and many works warn against the risks of using easily available and relatively simple proxies, such as journal impact factor. The present work continues this line of research, examining whether it is valid that the use of the impact factor should always be avoided in favour of citations, or whether the use of impact factor could be acceptable, even preferable, in certain circumstances. The evaluation was conducted by observing all scientific publications in the hard sciences by Italian universities, for the period 2004-2007. Performance sensitivity analyses were conducted with changing indicators of quality and years of observation.
References in corpus (1)
Cited by in corpus (12)
- Predicting long-term publication impact through a combination of early citations and journal impact factor
- Revisiting the scientometric conceptualization of impact and its measurement
- The VQR, Italy's second national research assessment: Methodological failures and ranking distortions
- Career advancement and scientific performance in universities
- Evaluating research and researchers by the journal impact factor: is it better than coin flipping?
- Refrain from adopting the combination of citation and journal metrics to grade publications, as used in the Italian national research assessment exercise (VQR 2011-2014)
- Promotional Language and the Adoption of Innovative Ideas in Science
- Do Citations and Readership Identify Seminal Publications?
- Are all citations worth the same? Valuing citations by the value of the citing items
- A methodology to measure the effectiveness of academic recruitment and turnover
- Comparing the impact of subfields in scientific journals
- Informed peer review for publication assessments: Are improved impact measures worth the hassle?