Universality of citation distributions: towards an objective measure of scientific impact

Abstract

We study the distributions of citations received by a single publication within several disciplines, spanning broad areas of science. We show that the probability that an article is cited $c$ times has large variations between different disciplines, but all distributions are rescaled on a universal curve when the relative indicator $c_f=c/c_0$ is considered, where $c_0$ is the average number of citations per article for the discipline. In addition we show that the same universal behavior occurs when citation distributions of articles published in the same field, but in different years, are compared. These findings provide a strong validation of $c_f$ as an unbiased indicator for citation performance across disciplines and years. Based on this indicator, we introduce a generalization of the h-index suitable for comparing scientists working in different fields.

arXiv comment7 pages, 5 figures. accepted for publication in Proc. Natl Acad. Sci. USA

References in corpus (8)

• An index to quantify an individual's scientific research output
• How Popular is Your Paper? An Empirical Study of the Citation Distribution
• Does the h-index have predictive power?
• Citation Statistics from 110 Years of Physical Review
• Citation Statistics
• Scaling and universality in proportional elections
• Ivory Tower Universities and Competitive Business Firms
• National Scientific Facilities and Their Science Impact on Non-Biomedical Research

Cited by in corpus (191)

• Historical comparison of gender inequality in scientific careers across countries and disciplines
• Scale-free networks are rare
• Quantifying Long-Term Scientific Impact
• Analyzing and Modeling Real-World Phenomena with Complex Networks: A Survey of Applications
• The Preeminence of Ethnic Diversity in Scientific Collaboration
• The Matthew effect in empirical data
• Defining and identifying Sleeping Beauties in science
• An index to quantify an individual's scientific research output that takes into account the effect of multiple coauthorship
• Diffusion of scientific credits and the ranking of scientists
• Reputation and Impact in Academic Careers
• World citation and collaboration networks: uncovering the role of geography in science
• Citation analysis may severely underestimate the impact of clinical research as compared to basic research
• Weighted Multiplex Networks
• Quantitative and empirical demonstration of the Matthew effect in a study of career longevity
• Ranking in evolving complex networks
• A review of the characteristics of 108 author-level bibliometric indicators
• The h-index is no longer an effective correlate of scientific reputation
• Hot Streaks in Artistic, Cultural, and Scientific Careers
• Characterizing and modeling citation dynamics
• Persistence and Uncertainty in the Academic Career
• Career on the Move: Geography, Stratification, and Scientific Impact
• Quantifying patterns of research interest evolution
• Quantifying the impact of weak, strong, and super ties in scientific careers
• Who is the best player ever? A complex network analysis of the history of professional tennis
• The Chaperone Effect in Scientific Publishing
• Regression for citation data: An evaluation of different methods
• On the Predictability of Future Impact in Science
• The field-standardized average impact of national research systems compared to world average: the case of Italy
• Modeling and Predicting Popularity Dynamics via Reinforced Poisson Processes
• Early-career setback and future career impact
• Computational Socioeconomics
• Methods for measuring the citations and productivity of scientists across time and discipline
• Rescaling citations of publications in physics
• A reverse engineering approach to the suppression of citation biases reveals universal properties of citation distributions
• Human Activity in the Web
• Universality of scholarly impact metrics
• Unfolding the innovation system for the development of countries: co-evolution of Science, Technology and Production
• The Memory of Science: Inflation, Myopia, and the Knowledge Network
• Revisiting the scaling of citations for research assessment
• Identification of milestone papers through time-balanced network centrality
• The discretised lognormal and hooked power law distributions for complete citation data: Best options for modelling and regression
• Can Scientific Impact Be Predicted?
• Early identification of important patents through network centrality
• Testing the fairness of citation indicators for comparison across scientific domains: the case of fractional citation counts
• Statistical regularities in the rank-citation profile of scientists
• A measure of total research impact independent of time and discipline
• Stochastic dynamical model of a growing network based on self-exciting point process
• Taking census of physics
• Inheritance patterns in citation networks reveal scientific memes
• Universality of citation distributions for academic institutions and journals
• Modelling Citation Networks
• The precision of the arithmetic mean, geometric mean and percentiles for citation data: An experimental simulation modelling approach
• Quantifying and suppressing ranking bias in a large citation network
• Analysis of bibliometric indicators for individual scholars in a large data set
• Will This Paper Increase Your h-index? Scientific Impact Prediction
• Grand challenges and emergent modes of convergence science
• Lognormal Infection Times of Online Information Spread
• The Distribution of the Asymptotic Number of Citations to Sets of Publications by a Researcher or From an Academic Department Are Consistent With a Discrete Lognormal Model
• Universality of Performance Indicators based on Citation and Reference Counts
• Distributions for cited articles from individual subjects and years
• How to Create an Innovation Accelerator
• What happens when a journal converts to Open Access? A bibliometric analysis
• The statistical laws of popularity: Universal properties of the box office dynamics of motion pictures
• Fame and Obsolescence: Disentangling growth and ageing dynamics of patent citations
• Inequality and cumulative advantage in science careers: a case study of high-impact journals
• Runaway Events Dominate the Heavy Tail of Citation Distributions
• The Time Dimension of Science: Connecting the Past to the Future
• Quality versus quantity in scientific impact
• A Proposal to Classify Latinamerican Scientific Journals using Citation Indicators: Case Study in Colombia
• Science and Facebook: the same popularity law!
• Unraveling the dynamics of growth, aging and inflation for citations to scientific articles from specific research fields
• Zipf's law and log-normal distributions in measures of scientific output across fields and institutions: 40 years of Slovenia's research as an example
• Citation score normalized by cited references (CSNCR): The introduction of a new citation impact indicator
• Are there too many uncited articles? Zero inflated variants of the discretised lognormal and hooked power law distributions
• In science "there is no bad publicity": Papers criticized in comments have high scientific impact
• Evaluating the impact of interdisciplinary research: a multilayer network approach
• Relative clock demonstrates the endogenous heterogeneity of human dynamics
• National, disciplinary and temporal variations in the extent to which articles with more authors have more impact: Evidence from a geometric field normalised citation indicator
• Become a better you: correlation between the change of research direction and the change of scientific performance
• Quantifying the distribution of editorial power and manuscript decision bias at the mega-journal PLOS ONE
• Impact Factors and the Central Limit Theorem: Why Citation Averages Are Scale Dependent
• Bibliometric Indicators of Young Authors in Astrophysics: Can Later Stars be Predicted?
• Completing $h$
• Network-based statistical comparison of citation topology of bibliographic databases
• A Century of Science: Globalization of Scientific Collaborations, Citations, and Innovations
• Statistical validation of high-dimensional models of growing networks
• The suitability of h and g indexes for measuring the research performance of institutions. Scientometrics, 97(3), 555-570
• The distribution of shortest path lengths in a class of node duplication network models
• What is the dimension of citation space?
• The disruption index is biased by citation inflation
• Meta-validation of bipartite network projections
• Model-based evaluation of scientific impact indicators
• Prediction Methods and Applications in the Science of Science: A Survey
• From Who You Know to What You Read: Augmenting Scientific Recommendations with Implicit Social Networks
• Geography of Science: Competitiveness and Inequality
• The citation wake of publications detects Nobel laureates' papers
• The Effects of Data Quality on the Analysis of Corporate Board Interlock Networks
• A theoretical model for the associative nature of conference participation
• A Case Study of the Arbitrariness of the h-Index and the Highly-Cited-Publications Indicator
• Assessing the accuracy of the h and g indexes for measuring researchers' productivity
• Detrending career statistics in professional baseball: Accounting for the steroids era and beyond
• Citation count distributions for large monodisciplinary journals
• Measuring Metrics - A forty year longitudinal cross-validation of citations, downloads, and peer review in Astrophysics
• A multivariate stochastic model to assess research performance
• The Z-index: A geometric representation of productivity and impact which accounts for information in the entire rank-citation profile
• The disruption index suffers from citation inflation and is confounded by shifts in scholarly citation practice
• Organization of networks with tagged nodes and biased links: a priori distinct communities. The case of Intelligent Design Proponents and Darwinian Evolution Defenders
• The inconsistency of h-index: a mathematical analysis
• The transition towards immortality: non-linear autocatalytic growth of citations to scientific papers
• Identifying time dependence in network growth
• Relational hyperevent models for the coevolution of coauthoring and citation networks
• Research assessment by percentile-based double rank analysis
• The citation disadvantage of clinical research
• Nature, Science, and PNAS -- Disciplinary profiles and impact
• Analytical results for the distribution of shortest path lengths in directed random networks that grow by node duplication
• How important is choice of the scaling factor in standardizing citations?
• Testing for universality of Mendeley readership distributions
• Fat tailed distributions for deaths in conflicts and disasters
• Socio-economic inequalities: a statistical physics perspective
• Scientometric engineering: Exploring citation dynamics via arXiv eprints
• Publication boost in Web of Science journals and its effect on citation distributions
• Field-normalized Impact Factors: A Comparison of Rescaling versus Fractionally Counted IFs
• A robust benchmark for the h- and g-indexes
• Higher-order rich-club phenomenon in collaborative research grants
• Quantifying invariant features of within-group inequality in consumption across groups
• Propinquity drives the emergence of network structure and density
• A review of the literature on citation impact indicators
• Funnel plots for visualizing uncertainty in the research performance of institutions
• A multi-dimensional framework for characterizing the citation impact of scientific publications
• Recency predicts bursts in the evolution of author citations
• Towards a more realistic citation model: The key role of research team sizes
• Exploring cost-benefit analysis of research, development and innovation infrastructures: an evaluation framework
• On the origin of burstiness in human behavior: The wikipedia edits case
• Motif-based success scores in coauthorship networks are highly sensitive to author name disambiguation
• Analyzing Linguistic Complexity and Scientific Impact
• Using Machine Learning to Predict the Evolution of Physics Research
• Axiomatic Quantification of Co-authors' Relative Contributions
• Analytical results for the in-degree and out-degree distributions of directed random networks that grow by node duplication
• Individual and team performance in cricket
• Comparing the impact of subfields in scientific journals
• Anomalous diffusion in the citation time series of scientific publications
• Fractional counting of authorship to quantify scientific research output
• Topic-adjusted visibility metric for scientific articles
• A SIR epidemic model for citation dynamics
• The advantages of interdisciplinarity in modern science
• The Evolution of Competitiveness across Economic, Innovation and Knowledge production activities
• From closed to open access: A case study of flipped journals
• Modeling nonuniversal citation distributions: the role of scientific journals
• The Sci-hub Effect: Sci-hub downloads lead to more article citations
• Quantifying Success in Science: An Overview
• Are human interactivity times lognormal?
• How the fittest compete for leadership: A tale of tails
• Do 'altmetric mentions' follow Power Laws? Evidence from social media mention data in Altmetric.com
• Interdisciplinary researchers attain better performance in funding
• Frequently Co-cited Publications: Features and Kinetics
• Two indicators rule them all: Mean and standard deviation used to calculate other journal indicators based on log-normal distribution of citation counts
• On the evolution and utility of annual citation indices
• Fractional counting of citations in research evaluation: An option for cross- and interdisciplinary assessments
• Characterizing References from Different Disciplines: A Perspective of Citation Content Analysis
• Caveats for the journal and field normalizations in the CWTS ("Leiden") evaluations of research performance
• Modeling citation networks based on vigorousness and dormancy
• Scientific Productivity, Research Funding, Race and Ethnicity
• On the categorization of scientific citation profiles in computer sciences
• Source normalized indicators of citation impact: An overview of different approaches and an empirical comparison
• Bounded Rationality in Scholarly Knowledge Discovery
• Probability and expected frequency of breakthroughs - a robust method of research assessment based on the double rank property of citation distributions
• Addressing Time Bias in Bipartite Graph Ranking for Important Node Identification
• Empirical Patterns in Google Scholar Citation Counts
• Clean up or mess up: the effect of sampling biases on measurements of degree distributions in mobile phone datasets
• Enabling Discoveries: Thirty Years of Advanced Technologies and Instrumentation at the National Science Foundation
• Uncertain research country rankings. Should we continue producing uncertain rankings?
• Turning the tables in citation analysis one more time: Principles for comparing sets of documents
• Modeling the Interplay Between Individual Behavior and Network Distributions
• Fractional stochastic model of citation dynamics with memory and volatility
• A Measure of Research Taste
• Citation method, please? A case study in astrophysics
• Are the discretised lognormal and hooked power law distributions plausible for citation data?
• On the Predictability of Utilizing Rank Percentile to Evaluate Scientific Impact
• A network-based citation indicator of scientific performance
• The normalization of citation counts based on classification systems
• A systematic empirical comparison of different approaches for normalizing citation impact indicators
• Coevolution of theoretical and applied research: a case study of graphene research by temporal and geographic analysis
• An Overview on Evaluating and Predicting Scholarly Article Impact
• Universal growth of social groups: empirical analysis and modeling
• Memory-cognizant generalization to Simon's random-copying neutral model
• Super-teams or fair leagues? Parity policies by powerful regulators don't prevent capture
• A two-dimensional index to quantify both scientific research impact and scope
• Universality of citation distributions revisited
• How Can Journal Impact Factors be Normalized across Fields of Science? An Assessment in terms of Percentile Ranks and Fractional Counts
• The skewness of computer science
• Conservative adventurers have more future academic impact