Open data to evaluate academic researchers: an experiment with the Italian Scientific Habilitation
arXiv:1902.03287
Abstract
The need for scholarly open data is ever increasing. While there are large repositories of open access articles and free publication indexes, there are still a few examples of free citation networks and their coverage is partial. One of the results is that most of the evaluation processes based on citation counts rely on commercial citation databases. Things are changing under the pressure of the Initiative for Open Citations (I4OC), whose goal is to campaign for scholarly publishers to make their citations as totally open. This paper investigates the growth of open citations with an experiment on the Italian Scientific Habilitation, the National process for University Professor qualification which instead uses data from commercial indexes. We simulated the procedure by only using open data and explored similarities and differences with the official results. The outcomes of the experiment show that the amount of open citation data currently available is not yet enough for obtaining similar results.
12 pages, 1 figure, 6 tables, submitted to the 17th International Conference on Scientometrics and Informentrics (ISSI 2019)
References in corpus (4)
- Allocative efficiency in public research funding:can bibliometrics help?
- Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data
- An assessment of the first "scientific accreditation" for university appointments in Italy
- Quantitative Analysis of the Italian National Scientific Qualification
Cited by in corpus (6)
- COCI, the OpenCitations Index of Crossref open DOI-to-DOI citations
- The practice of self-citations: a longitudinal study
- Does the Venue of Scientific Conferences Leverage their Impact? A Large Scale study on Computer Science Conferences
- Do open citations give insights on the qualitative peer-review evaluation in research assessments? An analysis of the Italian National Scientific Qualification
- Can we assess research using open scientific knowledge graphs? A case study within the Italian National Scientific Qualification
- Self-citation Analysis using Sentence Embeddings