RecSim NG: Toward Principled Uncertainty Modeling for Recommender Ecosystems

Abstract

The development of recommender systems that optimize multi-turn interaction with users, and model the interactions of different agents (e.g., users, content providers, vendors) in the recommender ecosystem have drawn increasing attention in recent years. Developing and training models and algorithms for such recommenders can be especially difficult using static datasets, which often fail to offer the types of counterfactual predictions needed to evaluate policies over extended horizons. To address this, we develop RecSim NG, a probabilistic platform for the simulation of multi-agent recommender systems. RecSim NG is a scalable, modular, differentiable simulator implemented in Edward2 and TensorFlow. It offers: a powerful, general probabilistic programming language for agent-behavior specification; tools for probabilistic inference and latent-variable model learning, backed by automatic differentiation and tracing; and a TensorFlow-based runtime for running simulations on accelerated hardware. We describe RecSim NG and illustrate how it can be used to create transparent, configurable, end-to-end models of a recommender ecosystem, complemented by a small set of simple use cases that demonstrate how RecSim NG can help both researchers and practitioners easily develop and train novel algorithms for recommender systems.

References in corpus (12)

• Empirical Analysis of Predictive Algorithms for Collaborative Filtering
• Object-Oriented Bayesian Networks
• Challenges of Real-World Reinforcement Learning
• Dopamine: A Research Framework for Deep Reinforcement Learning
• Deep Probabilistic Programming
• Reinforcement Learning based Recommender System using Biclustering Technique
• RecSim: A Configurable Simulation Platform for Recommender Systems
• The AI Economist: Improving Equality and Productivity with AI-Driven Tax Policies
• Reinforcement Learning for Slate-based Recommender Systems: A Tractable Decomposition and Practical Methodology
• Measuring Recommender System Effects with Simulated Users
• Optimizing Long-term Social Welfare in Recommender Systems: A Constrained Matching Approach
• WES: Agent-based User Interaction Simulation on Real Infrastructure

Cited by in corpus (3)

• Recommendation Fairness: From Static to Dynamic
• Understanding Longitudinal Dynamics of Recommender Systems with Agent-Based Modeling and Simulation
• T-RECS: A Simulation Tool to Study the Societal Impact of Recommender Systems