Inferring Gender from Names on the Web: A Comparative Evaluation of Gender Detection Methods

Abstract

Computational social scientists often harness the Web as a "societal observatory" where data about human social behavior is collected. This data enables novel investigations of psychological, anthropological and sociological research questions. However, in the absence of demographic information, such as gender, many relevant research questions cannot be addressed. To tackle this problem, researchers often rely on automated methods to infer gender from name information provided on the web. However, little is known about the accuracy of existing gender-detection methods and how biased they are against certain sub-populations. In this paper, we address this question by systematically comparing several gender detection methods on a random sample of scientists for whom we know their full name, their gender and the country of their workplace. We further suggest a novel method that employs web-based image retrieval and gender recognition in facial images in order to augment name-based approaches. Our findings show that the performance of name-based gender detection approaches can be biased towards countries of origin and such biases can be reduced by combining name-based an image-based gender detection methods.

arXiv comment2 pages, WWW conference

References in corpus (2)

• The role of gender in scholarly authorship
• Naive-Deep Face Recognition: Touching the Limit of LFW Benchmark or Not?

Cited by in corpus (22)

• Homophily and minority size explain perception biases in social networks
• Through a Gender Lens: Learning Usage Patterns of Emojis from Large-Scale Android Users
• Gender Differences in Participation and Reward on Stack Overflow
• Including Everyone, Everywhere: Understanding Opportunities and Challenges of Geographic Gender-Inclusion in OSS
• The many facets of academic mobility and its impact on scholars' career
• White, Man, and Highly Followed: Gender and Race Inequalities in Twitter
• Gender trends in computer science authorship
• Demographics of News Sharing in the U.S. Twittersphere
• First-mover advantage explains gender disparities in physics citations
• Gender Inference using Statistical Name Characteristics in Twitter
• Linguistic Diversities of Demographic Groups in Twitter
• Which Factors are associated with Open Access Publishing? A Springer Nature Case Study
• "(Weitergeleitet von Journalistin)": The Gendered Presentation of Professions on Wikipedia
• Dynamics of Gender Bias in Computing
• Improving the visibility of minorities through network growth interventions
• Analyzing the network structure and gender differences among the members of the Networked Knowledge Organization Systems (NKOS) community
• Individual and gender inequality in computer science: A career study of cohorts from 1970 to 2000
• Gender Bias in Big Data Analysis
• Simulating systematic bias in attributed social networks and its effect on rankings of minority nodes
• Gender assignment in doctoral theses: revisiting Teseo with a method based on cultural consensus theory
• Underrepresentation of women in computer systems research
• Recommendation Fairness in Social Networks Over Time