Diffusion-based Contrastive Learning for Sequential Recommendation

Abstract

Contrastive learning has been effectively utilized to enhance the training of sequential recommendation models by leveraging informative self-supervised signals. Most existing approaches generate augmented views of the same user sequence through random augmentation and subsequently maximize their agreement in the representation space. However, these methods often neglect the rationality of the augmented samples. Due to significant uncertainty, random augmentation can disrupt the semantic information and interest evolution patterns inherent in the original user sequences. Moreover, pulling semantically inconsistent sequences closer in the representation space can render the user sequence embeddings insensitive to variations in user preferences, which contradicts the primary objective of sequential recommendation. To address these limitations, we propose the Context-aware Diffusion-based Contrastive Learning for Sequential Recommendation, named CaDiRec. The core idea is to leverage context information to generate more reasonable augmented views. Specifically, CaDiRec employs a context-aware diffusion model to generate alternative items for the given positions within a sequence. These generated items are aligned with their respective context information and can effectively replace the corresponding original items, thereby generating a positive view of the original sequence. By considering two different augmentations of the same user sequence, we can construct a pair of positive samples for contrastive learning. To ensure representation cohesion, we train the entire framework in an end-to-end manner, with shared item embeddings between the diffusion model and the recommendation model. Extensive experiments on five benchmark datasets demonstrate the advantages of our proposed method over existing baselines.

Published as a full paper in CIKM'2024

References in corpus (12)

• Self-supervised Graph Learning for Recommendation
• S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization
• Contrastive Learning for Representation Degeneration Problem in Sequential Recommendation
• Intent Contrastive Learning for Sequential Recommendation
• Diffusion-LM Improves Controllable Text Generation
• Debiased Contrastive Learning for Sequential Recommendation
• Automated Self-Supervised Learning for Recommendation
• Multi-Behavior Sequential Recommendation with Temporal Graph Transformer
• RecDCL: Dual Contrastive Learning for Recommendation
• Meta-optimized Contrastive Learning for Sequential Recommendation
• Dynamically Expandable Graph Convolution for Streaming Recommendation
• Dynamic Embedding Size Search with Minimum Regret for Streaming Recommender System

Cited by in corpus (2)

• Modeling Long-term User Behaviors with Diffusion-driven Multi-interest Network for CTR Prediction
• SimDiffRec: Semantic Similarity-Guided Diffusion for Contrastive Sequential Recommendation