Dimension Independent Mixup for Hard Negative Sample in Collaborative Filtering

Abstract

Collaborative filtering (CF) is a widely employed technique that predicts user preferences based on past interactions. Negative sampling plays a vital role in training CF-based models with implicit feedback. In this paper, we propose a novel perspective based on the sampling area to revisit existing sampling methods. We point out that current sampling methods mainly focus on Point-wise or Line-wise sampling, lacking flexibility and leaving a significant portion of the hard sampling area un-explored. To address this limitation, we propose Dimension Independent Mixup for Hard Negative Sampling (DINS), which is the first Area-wise sampling method for training CF-based models. DINS comprises three modules: Hard Boundary Definition, Dimension Independent Mixup, and Multi-hop Pooling. Experiments with real-world datasets on both matrix factorization and graph-based models demonstrate that DINS outperforms other negative sampling methods, establishing its effectiveness and superiority. Our work contributes a new perspective, introduces Area-wise sampling, and presents DINS as a novel approach that achieves state-of-the-art performance for negative sampling. Our implementations are available in PyTorch.

References in corpus (18)

• Adam: A Method for Stochastic Optimization
• mixup: Beyond Empirical Risk Minimization
• BPR: Bayesian Personalized Ranking from Implicit Feedback
• Neural Graph Collaborative Filtering
• Graph Convolutional Neural Networks for Web-Scale Recommender Systems
• Self-supervised Graph Learning for Recommendation
• Graph Convolutional Matrix Completion
• IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models
• NPA: Neural News Recommendation with Personalized Attention
• Reinforced Negative Sampling over Knowledge Graph for Recommendation
• ConsisRec: Enhancing GNN for Social Recommendation via Consistent Neighbor Aggregation
• DGRec: Graph Neural Network for Recommendation with Diversified Embedding Generation
• Adversarial Sampling and Training for Semi-Supervised Information Retrieval
• Large-scale Personalized Video Game Recommendation via Social-aware Contextualized Graph Neural Network
• Simplify and Robustify Negative Sampling for Implicit Collaborative Filtering
• SimpleX: A Simple and Strong Baseline for Collaborative Filtering
• SVD-GCN: A Simplified Graph Convolution Paradigm for Recommendation
• Enhancing Recommender Systems: A Strategy to Mitigate False Negative Impact