How well developed are altmetrics? A cross-disciplinary analysis of the presence of 'alternative metrics' in scientific publications
arXiv:1404.1301 · doi:10.1007/s11192-014-1264-0
Abstract
In this paper an analysis of the presence and possibilities of altmetrics for bibliometric and performance analysis is carried out. Using the web based tool Impact Story, we collected metrics for 20,000 random publications from the Web of Science. We studied both the presence and distribution of altmetrics in the set of publications, across fields, document types and over publication years, as well as the extent to which altmetrics correlate with citation indicators. The main result of the study is that the altmetrics source that provides the most metrics is Mendeley, with metrics on readerships for 62.6% of all the publications studied, other sources only provide marginal information. In terms of relation with citations, a moderate spearman correlation (r=0.49) has been found between Mendeley readership counts and citation indicators. Other possibilities and limitations of these indicators are discussed and future research lines are outlined.
References in corpus (7)
- A principal component analysis of 39 scientific impact measures
- Altmetrics in the wild: Using social media to explore scholarly impact
- How the Scientific Community Reacts to Newly Submitted Preprints: Article Downloads, Twitter Mentions, and Citations
- Beyond citations: Scholars' visibility on the social Web
- Altmetrics: New Indicators for Scientific Communication in Web 2.0
- Manipulating Google Scholar Citations and Google Scholar Metrics: simple, easy and tempting
- Towards Usage-based Impact Metrics: - First Results from the MESUR Project
Cited by in corpus (28)
- Do altmetrics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective
- A Systematic Identification and Analysis of Scientists on Twitter
- Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data
- Regression for citation data: An evaluation of different methods
- New data, new possibilities: Exploring the insides of Altmetric.com
- Could scientists use Altmetric.com scores to predict longer term citation counts?
- Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK Research Excellence Framework (REF)
- How many scientific papers are mentioned in policy-related documents? An empirical investigation using Web of Science and Altmetric data
- An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics
- Geometric journal impact factors correcting for individual highly cited articles
- Mendeley readership as a filtering tool to identify highly cited publications
- National research impact indicators from Mendeley readers
- Microsoft Academic: A multidisciplinary comparison of citation counts with Scopus and Mendeley for 29 journals
- The stability of Twitter metrics: A study on unavailable Twitter mentions of scientific publications
- Visualization of Co-Readership Patterns from an Online Reference Management System
- Measuring field-normalized impact of papers on specific societal groups: An altmetrics study based on Mendeley data
- A multi-dimensional analysis of usage counts, Mendeley readership, and citations for journal and conference papers
- Testing for universality of Mendeley readership distributions
- The Values and Limits of Altmetrics
- Measuring impact in research evaluations: A thorough discussion of methods for, effects of, and problems with impact measurements
- Are papers addressing certain diseases perceived where these diseases are prevalent? The proposal to use Twitter data as social-spatial sensors
- Altmetrics can capture research evidence: a study across types of studies in COVID-19 literature
- Usefulness of altmetrics for measuring the broader impact of research: A case study using data from PLOS (altmetrics) and F1000Prime (paper tags)
- Ruling Out Static Latent Homophily in Citation Networks
- Social media uptake of scientific journals: A comparison between X and WeChat
- Measuring Social Media Activity of Scientific Literature: An Exhaustive Comparison of Scopus and Novel Altmetrics Big Data
- Mapping the impact of papers on various status groups: A new excellence mapping tool based on citation and reader scores
- Alternative metrics in scientometrics: A meta-analysis of research into three altmetrics