Graph Transformer for Recommendation
arXiv:2306.02330 · doi:10.1145/3539618.3591723
Abstract
This paper presents a novel approach to representation learning in recommender systems by integrating generative self-supervised learning with graph transformer architecture. We highlight the importance of high-quality data augmentation with relevant self-supervised pretext tasks for improving performance. Towards this end, we propose a new approach that automates the self-supervision augmentation process through a rationale-aware generative SSL that distills informative user-item interaction patterns. The proposed recommender with Graph TransFormer (GFormer) that offers parameterized collaborative rationale discovery for selective augmentation while preserving global-aware user-item relationships. In GFormer, we allow the rationale-aware SSL to inspire graph collaborative filtering with task-adaptive invariant rationalization in graph transformer. The experimental results reveal that our GFormer has the capability to consistently improve the performance over baselines on different datasets. Several in-depth experiments further investigate the invariant rationale-aware augmentation from various aspects. The source code for this work is publicly available at: https://github.com/HKUDS/GFormer.
Accepted by SIGIR'2023
References in corpus (12)
- Simplifying Graph Convolutional Networks
- S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization
- Disentangled Graph Collaborative Filtering
- Improving Graph Collaborative Filtering with Neighborhood-enriched Contrastive Learning
- Hypergraph Contrastive Collaborative Filtering
- Debiased Contrastive Learning for Sequential Recommendation
- A Review-aware Graph Contrastive Learning Framework for Recommendation
- DisenHAN: Disentangled Heterogeneous Graph Attention Network for Recommendation
- LightGCL: Simple Yet Effective Graph Contrastive Learning for Recommendation
- Graph Contrastive Learning Automated
- Discovering Invariant Rationales for Graph Neural Networks
- Graph-less Collaborative Filtering