User and Recommender Behavior Over Time: Contextualizing Activity, Effectiveness, Diversity, and Fairness in Book Recommendation

Abstract

Data is an essential resource for studying recommender systems. While there has been significant work on improving and evaluating state-of-the-art models and measuring various properties of recommender system outputs, less attention has been given to the data itself, particularly how data has changed over time. Such documentation and analysis provide guidance and context for designing and evaluating recommender systems, particularly for evaluation designs making use of time (e.g., temporal splitting). In this paper, we present a temporal explanatory analysis of the UCSD Book Graph dataset scraped from Goodreads, a social reading and recommendation platform active since 2006. We measure the book interaction data using a set of activity, diversity, and fairness metrics; we then train a set of collaborative filtering algorithms on rolling training windows to observe how the same measures evolve over time in the recommendations. Additionally, we explore whether the introduction of algorithmic recommendations in 2011 was followed by observable changes in user or recommender system behavior.

8 pages, 9 figures

References in corpus (9)

• A Survey on the Fairness of Recommender Systems
• How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utility
• Fairness in Recommender Systems: Research Landscape and Future Directions
• Towards Long-term Fairness in Recommendation
• Fairness in Information Access Systems
• LensKit for Python: Next-Generation Software for Recommender System Experiments
• Distributionally-Informed Recommender System Evaluation
• It's Not You, It's Me: The Impact of Choice Models and Ranking Strategies on Gender Imbalance in Music Recommendation
• Unified Browsing Models for Linear and Grid Layouts