Graph-based Alignment and Uniformity for Recommendation

Abstract

Collaborative filtering-based recommender systems (RecSys) rely on learning representations for users and items to predict preferences accurately. Representation learning on the hypersphere is a promising approach due to its desirable properties, such as alignment and uniformity. However, the sparsity issue arises when it encounters RecSys. To address this issue, we propose a novel approach, graph-based alignment and uniformity (GraphAU), that explicitly considers high-order connectivities in the user-item bipartite graph. GraphAU aligns the user/item embedding to the dense vector representations of high-order neighbors using a neighborhood aggregator, eliminating the need to compute the burdensome alignment to high-order neighborhoods individually. To address the discrepancy in alignment losses, GraphAU includes a layer-wise alignment pooling module to integrate alignment losses layer-wise. Experiments on four datasets show that GraphAU significantly alleviates the sparsity issue and achieves state-of-the-art performance. We open-source GraphAU at https://github.com/YangLiangwei/GraphAU.

arXiv comment4 pages

References in corpus (14)

• Adam: A Method for Stochastic Optimization
• BPR: Bayesian Personalized Ranking from Implicit Feedback
• Neural Graph Collaborative Filtering
• Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering
• Disentangled Graph Collaborative Filtering
• LightGCN: Simplifying and Powering Graph Convolution Network for Recommendation
• Towards Representation Alignment and Uniformity in Collaborative Filtering
• ConsisRec: Enhancing GNN for Social Recommendation via Consistent Neighbor Aggregation
• DGRec: Graph Neural Network for Recommendation with Diversified Embedding Generation
• Large-scale Personalized Video Game Recommendation via Social-aware Contextualized Graph Neural Network
• UltraGCN: Ultra Simplification of Graph Convolutional Networks for Recommendation
• AutoLossGen: Automatic Loss Function Generation for Recommender Systems
• FeedRec: News Feed Recommendation with Various User Feedbacks
• Conditional Alignment and Uniformity for Contrastive Learning with Continuous Proxy Labels

Cited by in corpus (2)

• MixRec: Individual and Collective Mixing Empowers Data Augmentation for Recommender Systems
• Graph-Sequential Alignment and Uniformity: Toward Enhanced Recommendation Systems