Evaluating author name disambiguation for digital libraries: A case of DBLP

Abstract

Author name ambiguity in a digital library may affect the findings of research that mines authorship data of the library. This study evaluates author name disambiguation in DBLP, a widely used but insufficiently evaluated digital library for its disambiguation performance. In doing so, this study takes a triangulation approach that author name disambiguation for a digital library can be better evaluated when its performance is assessed on multiple labeled datasets with comparison to baselines. Tested on three types of labeled data containing 5,000 ~ 700K disambiguated names and 6M pairs of disambiguated names, DBLP is shown to assign author names quite accurately to distinct authors, resulting in pairwise precision, recall, and F1 measures around 0.90 or above overall. DBLP's author name disambiguation performs well even on large ambiguous name blocks but deficiently on distinguishing authors with the same names. When compared to other disambiguation algorithms, DBLP's disambiguation performance is quite competitive, possibly due to its hybrid disambiguation approach combining algorithmic disambiguation and manual error correction. A discussion follows on strengths and weaknesses of labeled datasets used in this study for future efforts to evaluate author name disambiguation on a digital library scale.

Scientometrics (2018)

References in corpus (3)

• A heuristic approach to author name disambiguation in bibliometrics databases for large-scale research assessments
• Distortive Effects of Initial-Based Name Disambiguation on Measurements of Large-Scale Coauthorship Networks
• Homonym Detection in Curated Bibliographies: Learning from dblp's Experience (full version)

Cited by in corpus (12)

• Collecting large-scale publication data at the level of individual researchers: A practical proposal for author name disambiguation
• The impact of imbalanced training data on machine learning for author name disambiguation
• Author-Based Analysis of Conference versus Journal Publication in Computer Science
• ORCID-linked labeled data for evaluating author name disambiguation at scale
• Generating automatically labeled data for author name disambiguation: An iterative clustering method
• A fast and integrative algorithm for clustering performance evaluation in author name disambiguation
• Effect of forename string on author name disambiguation
• Scale-free collaboration networks: An author name disambiguation perspective
• Formational bounds of link prediction in collaboration networks
• Studying the characteristics of scientific communities using individual-level bibliometrics: the case of Big Data research
• LAGOS-AND: A Large Gold Standard Dataset for Scholarly Author Name Disambiguation
• Publishing Instincts: An Exploration-Exploitation Framework for Studying Academic Publishing Behavior and "Home Venues"