Invariant Collaborative Filtering to Popularity Distribution Shift

Abstract

Collaborative Filtering (CF) models, despite their great success, suffer from severe performance drops due to popularity distribution shifts, where these changes are ubiquitous and inevitable in real-world scenarios. Unfortunately, most leading popularity debiasing strategies, rather than tackling the vulnerability of CF models to varying popularity distributions, require prior knowledge of the test distribution to identify the degree of bias and further learn the popularity-entangled representations to mitigate the bias. Consequently, these models result in significant performance benefits in the target test set, while dramatically deviating the recommendation from users' true interests without knowing the popularity distribution in advance. In this work, we propose a novel learning framework, Invariant Collaborative Filtering (InvCF), to discover disentangled representations that faithfully reveal the latent preference and popularity semantics without making any assumption about the popularity distribution. At its core is the distillation of unbiased preference representations (i.e., user preference on item property), which are invariant to the change of popularity semantics, while filtering out the popularity feature that is unstable or outdated. Extensive experiments on five benchmark datasets and four evaluation settings (i.e., synthetic long-tail, unbiased, temporal split, and out-of-distribution evaluations) demonstrate that InvCF outperforms the state-of-the-art baselines in terms of popularity generalization ability on real recommendations. Visualization studies shed light on the advantages of InvCF for disentangled representation learning. Our codes are available at https://github.com/anzhang314/InvCF.

References in corpus (19)

• BPR: Bayesian Personalized Ranking from Implicit Feedback
• Neural Graph Collaborative Filtering
• KGAT: Knowledge Graph Attention Network for Recommendation
• Disentangled Graph Collaborative Filtering
• Session-based Social Recommendation via Dynamic Graph Attention Networks
• Causal Intervention for Leveraging Popularity Bias in Recommendation
• LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
• Towards a Definition of Disentangled Representations
• Towards Out-Of-Distribution Generalization: A Survey
• Causal Embeddings for Recommendation
• User-oriented Fairness in Recommendation
• DisenHAN: Disentangled Heterogeneous Graph Attention Network for Recommendation
• AutoDebias: Learning to Debias for Recommendation
• Deconfounded Recommendation for Alleviating Bias Amplification
• Connecting User and Item Perspectives in Popularity Debiasing for Collaborative Recommendation
• ESAM: Discriminative Domain Adaptation with Non-Displayed Items to Improve Long-Tail Performance
• CausPref: Causal Preference Learning for Out-of-Distribution Recommendation
• UltraGCN: Ultra Simplification of Graph Convolutional Networks for Recommendation
• Incorporating Bias-aware Margins into Contrastive Loss for Collaborative Filtering

Cited by in corpus (4)

• Robust Collaborative Filtering to Popularity Distribution Shift
• How Do Recommendation Models Amplify Popularity Bias? An Analysis from the Spectral Perspective
• D-Tracker: Modeling Interest Diffusion in Social Activity Tensor Data Streams
• I${}^3$-MRec: Invariant Learning with Information Bottleneck for Incomplete Modality Recommendation