Grand challenges in altmetrics: heterogeneity, data quality and dependencies
arXiv:1603.04939 · doi:10.1007/s11192-016-1910-9
Abstract
As uptake among researchers is constantly increasing, social media are finding their way into scholarly communication and, under the umbrella term altmetrics, were introduced to research evaluation. Fueled by technological possibilities and an increasing demand to demonstrate impact beyond the scientific community, altmetrics received great attention as potential democratizers of the scientific reward system and indicators of societal impact. This paper focuses on current challenges of altmetrics. Heterogeneity, data quality and particular dependencies are identified as the three major issues and discussed in detail with a particular emphasis on past developments in bibliometrics. The heterogeneity of altmetrics mirrors the diversity of the types of underlying acts, most of which take place on social media platforms. This heterogeneity has made it difficult to establish a common definition or conceptual framework. Data quality issues become apparent in the lack of accuracy, consistency and replicability of various altmetrics, which is largely affected by the dynamic nature of social media events. It is further highlighted that altmetrics are shaped by technical possibilities and depend particularly on the availability of APIs and DOIs, are strongly dependent on data providers and aggregators, and potentially influenced by technical affordances of underlying platforms.
References in corpus (4)
- Do altmetrics correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective
- Altmetrics in the wild: Using social media to explore scholarly impact
- Tweets vs. Mendeley readers: How do these two social media metrics differ?
- Social media in scholarly communication
Cited by in corpus (20)
- Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data
- Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK Research Excellence Framework (REF)
- Using almetrics for contextualised mapping of societal impact: From hits to networks
- An extensive analysis of the presence of altmetric data for Web of Science publications across subject fields and research topics
- Author-level metrics in the new academic profile platforms: The online behaviour of the Bibliometrics community
- The stability of Twitter metrics: A study on unavailable Twitter mentions of scientific publications
- Field- and time-normalization of data with many zeros: An empirical analysis using citation and Twitter data
- Using altmetrics for detecting impactful research in quasi-zero-day time-windows: the case of COVID-19
- How do academic topics shift across altmetric sources? A case study of the research area of Big Data
- Can We Count on Social Media Metrics? First Insights into the Active Scholarly Use of Social Media
- Are papers addressing certain diseases perceived where these diseases are prevalent? The proposal to use Twitter data as social-spatial sensors
- Scientific discourse on YouTube: Motivations for citing research in comments
- Cloud-Based Big Data Management and Analytics for Scholarly Resources: Current Trends, Challenges and Scope for Future Research
- Can we use altmetrics at the institutional level? A case study analysing the coverage by research areas of four Spanish universities
- 'I Updated the <ref>': The Evolution of References in the English Wikipedia and the Implications for Altmetrics
- Filling the citation gap: Measuring the multidimensional impact of the academic book at institutional level with PlumX
- Normalization of zero-inflated data: An empirical analysis of a new indicator family
- Assessment and support of emerging research groups
- Organisational accounts engaged in scholarly communication on Twitter: Patterns of presence, activity and engagement
- Social media uptake of scientific journals: A comparison between X and WeChat