Do altmetrics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective
arXiv:1401.4321 · doi:10.1002/asi.23309
Abstract
An extensive analysis of the presence of different altmetric indicators provided by Altmetric.com across scientific fields is presented, particularly focusing on their relationship with citations. Our results confirm that the presence and density of social media altmetric counts are still very low and not very frequent among scientific publications, with 15%-24% of the publications presenting some altmetric activity and concentrating in the most recent publications, although their presence is increasing over time. Publications from the social sciences, humanities and the medical and life sciences show the highest presence of altmetrics, indicating their potential value and interest for these fields. The analysis of the relationships between altmetrics and citations confirms previous claims of positive correlations but relatively weak, thus supporting the idea that altmetrics do not reflect the same concept of impact as citations. Also, altmetric counts do not always present a better filtering of highly cited publications than journal citation scores. Altmetrics scores (particularly mentions in blogs) are able to identify highly cited publications with higher levels of precision than journal citation scores (JCS), but they have a lower level of recall. The value of altmetrics as a complementary tool of citation analysis is highlighted, although more research is suggested to disentangle the potential meaning and value of altmetric indicators for research evaluation.
References in corpus (3)
Cited by in corpus (47)
- Dimensions: A Competitor to Scopus and the Web of Science?
- Grand challenges in altmetrics: heterogeneity, data quality and dependencies
- A Systematic Identification and Analysis of Scientists on Twitter
- Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data
- Could scientists use Altmetric.com scores to predict longer term citation counts?
- Predicting the long-term citation impact of recent publications
- Revisiting the scientometric conceptualization of impact and its measurement
- An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics
- Preprints as accelerator of scholarly communication: An empirical analysis in Mathematics
- Dimensions: re-discovering the ecosystem of scientific information
- Mendeley readership as a filtering tool to identify highly cited publications
- On the relationships between bibliographic characteristics of scientific documents and citation and Mendeley readership counts: A large-scale analysis of Web of Science publications
- Do altmetrics work for assessing research quality?
- Author-level metrics in the new academic profile platforms: The online behaviour of the Bibliometrics community
- Differences in Personal and Professional Tweets of Scholars
- Open Access Books in the Humanities and Social Sciences: an Open Access Altmetric Advantage
- Does presence of social media plugins in a journal website result in higher social media attention of its research publications
- Tracking the Digital Footprints to Scholarly Articles from Social Media
- The stability of Twitter metrics: A study on unavailable Twitter mentions of scientific publications
- Measuring the Diversity of Facebook Reactions to Research
- A large-scale comparison of social media coverage and mentions captured by the two altmetric aggregators- Altmetric.com and PlumX
- The Gene of Scientific Success
- The funding effect on citation and social attention: the UN Sustainable Development Goals (SDGs) as a case study
- A multi-dimensional analysis of usage counts, Mendeley readership, and citations for journal and conference papers
- Tracking the Twitter attention around the research efforts on the COVID-19 pandemic
- Social Media Attention Increases Article Visits: An Investigation on Article-Level Referral Data of PeerJ
- Testing for universality of Mendeley readership distributions
- The Values and Limits of Altmetrics
- WeChat uptake of Chinese scholarly journals: an analysis of CSSCI-indexed journals
- Do Mendeley readership counts help to filter highly cited WoS publications better than average citation impact of journals (JCS)?
- What increases (social) media attention: Research impact, author prominence or title attractiveness?
- Disciplinary Variations in Altmetric Coverage of Scholarly Articles
- A Framework for Scientific Paper Retrieval and Recommender Systems
- Tracing Digital Footprints to Academic Articles: An Investigation of PeerJ Publication Referral Data
- Can we use altmetrics at the institutional level? A case study analysing the coverage by research areas of four Spanish universities
- Quantifying Success in Science: An Overview
- Can social media provide early warning of retraction? Evidence from critical tweets identified by human annotation and large language models
- Do 'altmetric mentions' follow Power Laws? Evidence from social media mention data in Altmetric.com
- Convergence and Inequality in Research Globalization
- Measuring Social Media Activity of Scientific Literature: An Exhaustive Comparison of Scopus and Novel Altmetrics Big Data
- Breaking Community Boundary: Comparing Academic and Social Communication Preferences regarding Global Pandemics
- Public interest in science or bots? Selective amplification of scientific articles on Twitter
- Social media uptake of scientific journals: A comparison between X and WeChat
- The altmetric performance of publications authored by Brazilian researchers: analysis of CNPq productivity scholarship holders
- Do females create higher impact research? Scopus citations and Mendeley readers for articles from five countries
- Long live the scientists: Tracking the scientific fame of great minds in physics
- Can Google Scholar and Mendeley help to assess the scholarly impacts of dissertations?