HMAR: Hierarchical Masked Attention for Multi-Behaviour Recommendation

Abstract

In the context of recommendation systems, addressing multi-behavioral user interactions has become vital for understanding the evolving user behavior. Recent models utilize techniques like graph neural networks and attention mechanisms for modeling diverse behaviors, but capturing sequential patterns in historical interactions remains challenging. To tackle this, we introduce Hierarchical Masked Attention for multi-behavior recommendation (HMAR). Specifically, our approach applies masked self-attention to items of the same behavior, followed by self-attention across all behaviors. Additionally, we propose historical behavior indicators to encode the historical frequency of each items behavior in the input sequence. Furthermore, the HMAR model operates in a multi-task setting, allowing it to learn item behaviors and their associated ranking scores concurrently. Extensive experimental results on four real-world datasets demonstrate that our proposed model outperforms state-of-the-art methods. Our code and datasets are available here (https://github.com/Shereen-Elsayed/HMAR).

References in corpus (8)

• S^3-Rec: Self-Supervised Learning for Sequential Recommendation with Mutual Information Maximization
• Intent Contrastive Learning for Sequential Recommendation
• Graph Meta Network for Multi-Behavior Recommendation
• Multi-Behavior Hypergraph-Enhanced Transformer for Sequential Recommendation
• Multiplex Behavioral Relation Learning for Recommendation via Memory Augmented Transformer Network
• Multi-Behavior Recommendation with Cascading Graph Convolution Networks
• Knowledge Enhancement for Contrastive Multi-Behavior Recommendation
• CARCA: Context and Attribute-Aware Next-Item Recommendation via Cross-Attention