Causal Intervention for Leveraging Popularity Bias in Recommendation

Abstract

Recommender system usually faces popularity bias issues: from the data perspective, items exhibit uneven (long-tail) distribution on the interaction frequency; from the method perspective, collaborative filtering methods are prone to amplify the bias by over-recommending popular items. It is undoubtedly critical to consider popularity bias in recommender systems, and existing work mainly eliminates the bias effect. However, we argue that not all biases in the data are bad -- some items demonstrate higher popularity because of their better intrinsic quality. Blindly pursuing unbiased learning may remove the beneficial patterns in the data, degrading the recommendation accuracy and user satisfaction. This work studies an unexplored problem in recommendation -- how to leverage popularity bias to improve the recommendation accuracy. The key lies in two aspects: how to remove the bad impact of popularity bias during training, and how to inject the desired popularity bias in the inference stage that generates top-K recommendations. This questions the causal mechanism of the recommendation generation process. Along this line, we find that item popularity plays the role of confounder between the exposed items and the observed interactions, causing the bad effect of bias amplification. To achieve our goal, we propose a new training and inference paradigm for recommendation named Popularity-bias Deconfounding and Adjusting (PDA). It removes the confounding popularity bias in model training and adjusts the recommendation score with desired popularity bias via causal intervention. We demonstrate the new paradigm on latent factor model and perform extensive experiments on three real-world datasets. Empirical studies validate that the deconfounded training is helpful to discover user real interests and the inference adjustment with popularity bias could further improve the recommendation accuracy.

arXiv commentAppear in SIGIR 2021

References in corpus (17)

• Adam: A Method for Stochastic Optimization
• BPR: Bayesian Personalized Ranking from Implicit Feedback
• Neural Graph Collaborative Filtering
• Session-based Social Recommendation via Dynamic Graph Attention Networks
• LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
• How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utility
• Causal Embeddings for Recommendation
• Unbiased Learning to Rank with Unbiased Propensity Estimation
• Bias and Debias in Recommender System: A Survey and Future Directions
• Recommendations as Treatments: Debiasing Learning and Evaluation
• Managing Popularity Bias in Recommender Systems with Personalized Re-ranking
• Understanding Echo Chambers in E-commerce Recommender Systems
• Estimating Position Bias without Intrusive Interventions
• A Re-visit of the Popularity Baseline in Recommender Systems
• Real-time Attention Based Look-alike Model for Recommender System
• Information Theoretic Counterfactual Learning from Missing-Not-At-Random Feedback
• Popularity Bias in Recommendation: A Multi-stakeholder Perspective

Cited by in corpus (58)

• TALLRec: An Effective and Efficient Tuning Framework to Align Large Language Model with Recommendation
• A Survey on the Fairness of Recommender Systems
• Model-Agnostic Counterfactual Reasoning for Eliminating Popularity Bias in Recommender System
• Deconfounded Recommendation for Alleviating Bias Amplification
• Self-Supervised Hypergraph Transformer for Recommender Systems
• KuaiRec: A Fully-observed Dataset and Insights for Evaluating Recommender Systems
• A Survey on Popularity Bias in Recommender Systems
• Bias and Unfairness in Information Retrieval Systems: New Challenges in the LLM Era
• Trustworthy Graph Neural Networks: Aspects, Methods and Trends
• Graph Transformer for Recommendation
• A Critical Study on Data Leakage in Recommender System Offline Evaluation
• On the Effectiveness of Sampled Softmax Loss for Item Recommendation
• User-controllable Recommendation Against Filter Bubbles
• MISSRec: Pre-training and Transferring Multi-modal Interest-aware Sequence Representation for Recommendation
• Graph-less Collaborative Filtering
• Invariant Collaborative Filtering to Popularity Distribution Shift
• Comprehensive Fair Meta-learned Recommender System
• Unbiased Knowledge Distillation for Recommendation
• A Model-Agnostic Causal Learning Framework for Recommendation using Search Data
• Balancing Unobserved Confounding with a Few Unbiased Ratings in Debiased Recommendations
• Deconfounded Causal Collaborative Filtering
• It Is Different When Items Are Older: Debiasing Recommendations When Selection Bias and User Preferences Are Dynamic
• Debiasing Recommendation with Personal Popularity
• Robust Collaborative Filtering to Popularity Distribution Shift
• DVR: Micro-Video Recommendation Optimizing Watch-Time-Gain under Duration Bias
• Uncovering User Interest from Biased and Noised Watch Time in Video Recommendation
• Reformulating CTR Prediction: Learning Invariant Feature Interactions for Recommendation
• How Do Recommendation Models Amplify Popularity Bias? An Analysis from the Spectral Perspective
• Leveraging Watch-time Feedback for Short-Video Recommendations: A Causal Labeling Framework
• Going Beyond Popularity and Positivity Bias: Correcting for Multifactorial Bias in Recommender Systems
• Debiasing Sequential Recommenders through Distributionally Robust Optimization over System Exposure
• Popularity Bias Is Not Always Evil: Disentangling Benign and Harmful Bias for Recommendation
• The Bandwagon Effect: Not Just Another Bias
• LabelCraft: Empowering Short Video Recommendations with Automated Label Crafting
• Cross-modal Variational Auto-encoder for Content-based Micro-video Background Music Recommendation
• Ada-Ranker: A Data Distribution Adaptive Ranking Paradigm for Sequential Recommendation
• Capturing Popularity Trends: A Simplistic Non-Personalized Approach for Enhanced Item Recommendation
• The Importance of Causality in Decision Making: A Perspective on Recommender Systems
• Debiasing Neighbor Aggregation for Graph Neural Network in Recommender Systems
• Treatment Effect Estimation for User Interest Exploration on Recommender Systems
• Robust Basket Recommendation via Noise-tolerated Graph Contrastive Learning
• Mitigating Spurious Correlations for Self-supervised Recommendation
• Popularity Debiasing from Exposure to Interaction in Collaborative Filtering
• Recommendation Fairness: From Static to Dynamic
• Automatic Feature Fairness in Recommendation via Adversaries
• Neural Click Models for Recommender Systems
• Tricolore: Multi-Behavior User Profiling for Enhanced Candidate Generation in Recommender Systems
• Causality-aware Graph Aggregation Weight Estimator for Popularity Debiasing in Top-K Recommendation
• Connecting Domains and Contrasting Samples: A Ladder for Domain Generalization
• Performative Debias with Fair-exposure Optimization Driven by Strategic Agents in Recommender Systems
• "They've Over-Emphasized That One Search": Controlling Unwanted Content on TikTok's For You Page
• Countering Mainstream Bias via End-to-End Adaptive Local Learning
• Not All Videos Become Outdated: Short-Video Recommendation by Learning to Deconfound Release Interval Bias
• Investigating Characteristics of Media Recommendation Solicitation in r/ifyoulikeblank
• PipAttack: Poisoning Federated Recommender Systems forManipulating Item Promotion
• Searching Personal Collections
• Accurate and Diverse Recommendations via Propensity-Weighted Linear Autoencoders
• Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization