Wikipedia Reader Navigation: When Synthetic Data Is Enough
arXiv:2201.00812 · doi:10.1145/3488560.3498496
Abstract
Every day millions of people read Wikipedia. When navigating the vast space of available topics using hyperlinks, readers describe trajectories on the article network. Understanding these navigation patterns is crucial to better serve readers' needs and address structural biases and knowledge gaps. However, systematic studies of navigation on Wikipedia are hindered by a lack of publicly available data due to the commitment to protect readers' privacy by not storing or sharing potentially sensitive data. In this paper, we ask: How well can Wikipedia readers' navigation be approximated by using publicly available resources, most notably the Wikipedia clickstream data? We systematically quantify the differences between real navigation sequences and synthetic sequences generated from the clickstream data, in 6 analyses across 8 Wikipedia language versions. Overall, we find that the differences between real and synthetic sequences are statistically significant, but with small effect sizes, often well below 10%. This constitutes quantitative evidence for the utility of the Wikipedia clickstream data as a public resource: clickstream data can closely capture reader navigation on Wikipedia and provides a sufficient approximation for most practical downstream applications relying on reader data. More broadly, this study provides an example for how clickstream-like data can generally enable research on user navigation on online platforms while protecting users' privacy.
arXiv commentWSDM 2022, 11 pages, 16 figures
References in corpus (13)
- Scikit-learn: Machine Learning in Python
- DeepWalk: Online Learning of Social Representations
- Memory in network flows and its effects on spreading dynamics and community detection
- Detecting Memory and Structure in Human Navigation Patterns Using Markov Chain Models of Varying Order
- Why We Read Wikipedia
- First Women, Second Sex: Gender Bias in Wikipedia
- HypTrails: A Bayesian Approach for Comparing Hypotheses About Human Trails on the Web
- Improving Website Hyperlink Structure Using Server Logs
- What Makes a Link Successful on Wikipedia?
- A Large-Scale Characterization of How Readers Browse Wikipedia
- A Taxonomy of Knowledge Gaps for Wikimedia Projects (Second Draft)
- Random Surfers on a Web Encyclopedia
- Learning the Markov order of paths in a network