Can we use Google Scholar to identify highly-cited documents?
arXiv:1804.10439 · doi:10.1016/j.joi.2016.11.008
Abstract
The main objective of this paper is to empirically test whether the identification of highly-cited documents through Google Scholar is feasible and reliable. To this end, we carried out a longitudinal analysis (1950 to 2013), running a generic query (filtered only by year of publication) to minimise the effects of academic search engine optimisation. This gave us a final sample of 64,000 documents (1,000 per year). The strong correlation between a document's citations and its position in the search results (r= -0.67) led us to conclude that Google Scholar is able to identify highly-cited papers effectively. This, combined with Google Scholar's unique coverage (no restrictions on document type and source), makes the academic search engine an invaluable tool for bibliometric research relating to the identification of the most influential scientific documents. We find evidence, however, that Google Scholar ranks those documents whose language (or geographical web domain) matches with the user's interface language higher than could be expected based on citations. Nonetheless, this language effect and other factors related to the Google Scholar's operation, i.e. the proper identification of versions and the date of publication, only have an incidental impact. They do not compromise the ability of Google Scholar to identify the highly-cited papers.
References in corpus (4)
- The Google Scholar Experiment: how to index false papers and manipulate bibliometric indicators
- Methods for estimating the size of Google Scholar
- Back to the past: on the shoulders of an academic search engine giant
- Proceedings Scholar Metrics: H Index of proceedings on Computer Science, Electrical & Electronic Engineering, and Communications according to Google Scholar Metrics (2010-2014)
Cited by in corpus (9)
- Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations' COCI: a multidisciplinary comparison of coverage via citations
- Dimensions: A Competitor to Scopus and the Web of Science?
- Coverage of highly-cited documents in Google Scholar, Web of Science, and Scopus: a multidisciplinary comparison
- Evidence of Open Access of scientific publications in Google Scholar: a large-scale analysis
- How Frequently are Articles in Predatory Open Access Journals Cited
- How many preprints have actually been printed and why: a case study of computer science preprints on arXiv
- Author-level metrics in the new academic profile platforms: The online behaviour of the Bibliometrics community
- ResearchGate and Google Scholar: How much do they differ in publications, citations and different metrics and why?
- A novel method for depicting academic disciplines through Google Scholar Citations: The case of Bibliometrics