The Deconfounded Recommender: A Causal Inference Approach to Recommendation

Abstract

The goal of recommendation is to show users items that they will like. Though usually framed as a prediction, the spirit of recommendation is to answer an interventional question---for each user and movie, what would the rating be if we "forced" the user to watch the movie? To this end, we develop a causal approach to recommendation, one where watching a movie is a "treatment" and a user's rating is an "outcome." The problem is there may be unobserved confounders, variables that affect both which movies the users watch and how they rate them; unobserved confounders impede causal predictions with observational data. To solve this problem, we develop the deconfounded recommender, a way to use classical recommendation models for causal recommendation. Following Wang & Blei [23], the deconfounded recommender involves two probabilistic models. The first models which movies the users watch; it provides a substitute for the unobserved confounders. The second one models how each user rates each movie; it employs the substitute to help account for confounders. This two-stage approach removes bias due to confounding. It improves recommendation and enjoys stable performance against interventions on test sets.

arXiv comment15 pages

Cited by in corpus (12)

• Matrix Completion Methods for Causal Panel Data Models
• Correcting for Selection Bias in Learning-to-rank Systems
• User-controllable Recommendation Against Filter Bubbles
• Socially Responsible AI Algorithms: Issues, Purposes, and Challenges
• On Multi-Cause Causal Inference with Unobserved Confounding: Counterexamples, Impossibility, and Alternatives
• Disentangling User Interest and Conformity for Recommendation with Causal Embedding
• Identifiable Generative Models for Missing Not at Random Data Imputation
• Combining Offline Causal Inference and Online Bandit Learning for Data Driven Decision
• Asymmetric Tri-training for Debiasing Missing-Not-At-Random Explicit Feedback
• Sequential Deconfounding for Causal Inference with Unobserved Confounders
• Causal Learning for Socially Responsible AI
• Large-scale Causal Approaches to Debiasing Post-click Conversion Rate Estimation with Multi-task Learning