M2TRec: Metadata-aware Multi-task Transformer for Large-scale and Cold-start free Session-based Recommendations

Abstract

Session-based recommender systems (SBRSs) have shown superior performance over conventional methods. However, they show limited scalability on large-scale industrial datasets since most models learn one embedding per item. This leads to a large memory requirement (of storing one vector per item) and poor performance on sparse sessions with cold-start or unpopular items. Using one public and one large industrial dataset, we experimentally show that state-of-the-art SBRSs have low performance on sparse sessions with sparse items. We propose M2TRec, a Metadata-aware Multi-task Transformer model for session-based recommendations. Our proposed method learns a transformation function from item metadata to embeddings, and is thus, item-ID free (i.e., does not need to learn one embedding per item). It integrates item metadata to learn shared representations of diverse item attributes. During inference, new or unpopular items will be assigned identical representations for the attributes they share with items previously observed during training, and thus will have similar representations with those items, enabling recommendations of even cold-start and sparse items. Additionally, M2TRec is trained in a multi-task setting to predict the next item in the session along with its primary category and subcategories. Our multi-task strategy makes the model converge faster and significantly improves the overall performance. Experimental results show significant performance gains using our proposed approach on sparse items on the two datasets.

arXiv commentAccepted at the 16th ACM Conference on Recommender Systems (RecSys '22)

References in corpus (13)

• Deep Learning using Rectified Linear Units (ReLU)
• An Overview of Multi-Task Learning in Deep Neural Networks
• Session-based Recommendation with Graph Neural Networks
• Recurrent Neural Networks with Top-k Gains for Session-based Recommendations
• Global Context Enhanced Graph Neural Networks for Session-based Recommendation
• TAGNN: Target Attentive Graph Neural Networks for Session-based Recommendation
• Meta-Prod2Vec - Product Embeddings Using Side-Information for Recommendation
• Exploiting Cross-Session Information for Session-based Recommendation with Graph Neural Networks
• Incorporating User Micro-behaviors and Item Knowledge into Multi-task Learning for Session-based Recommendation
• Rank and Rate: Multi-task Learning for Recommender Systems
• SIGIR 2021 E-Commerce Workshop Data Challenge
• Transformers with multi-modal features and post-fusion context for e-commerce session-based recommendation
• On the Importance of News Content Representation in Hybrid Neural Session-based Recommender Systems

Cited by in corpus (5)

• Collaboration-Aware Graph Convolutional Network for Recommender Systems
• Code Recommendation for Open Source Software Developers
• beeFormer: Bridging the Gap Between Semantic and Interaction Similarity in Recommender Systems
• A Multimodal Single-Branch Embedding Network for Recommendation in Cold-Start and Missing Modality Scenarios
• Adversarial Text Rewriting for Text-aware Recommender Systems