Multi-Task Recommendations with Reinforcement Learning

Abstract

In recent years, Multi-task Learning (MTL) has yielded immense success in Recommender System (RS) applications. However, current MTL-based recommendation models tend to disregard the session-wise patterns of user-item interactions because they are predominantly constructed based on item-wise datasets. Moreover, balancing multiple objectives has always been a challenge in this field, which is typically avoided via linear estimations in existing works. To address these issues, in this paper, we propose a Reinforcement Learning (RL) enhanced MTL framework, namely RMTL, to combine the losses of different recommendation tasks using dynamic weights. To be specific, the RMTL structure can address the two aforementioned issues by (i) constructing an MTL environment from session-wise interactions and (ii) training multi-task actor-critic network structure, which is compatible with most existing MTL-based recommendation models, and (iii) optimizing and fine-tuning the MTL loss function using the weights generated by critic networks. Experiments on two real-world public datasets demonstrate the effectiveness of RMTL with a higher AUC against state-of-the-art MTL-based recommendation models. Additionally, we evaluate and validate RMTL's compatibility and transferability across various MTL models.

arXiv commentTheWebConf2023

References in corpus (13)

• Facial Expression Analysis under Partial Occlusion: A Survey
• Deep Reinforcement Learning for Page-wise Recommendations
• Recommendations with Negative Feedback via Pairwise Deep Reinforcement Learning
• Deep Reinforcement Learning in Large Discrete Action Spaces
• KuaiRand: An Unbiased Sequential Recommendation Dataset with Randomly Exposed Videos
• Deep Reinforcement Learning for List-wise Recommendations
• Deep Reinforcement Learning based Recommendation with Explicit User-Item Interactions Modeling
• Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Rate
• Multi-Task Fusion via Reinforcement Learning for Long-Term User Satisfaction in Recommender Systems
• Model-Based Reinforcement Learning with Adversarial Training for Online Recommendation
• Rank and Rate: Multi-task Learning for Recommender Systems
• Learning to Collaborate: Multi-Scenario Ranking via Multi-Agent Reinforcement Learning
• Kalman Filtering Attention for User Behavior Modeling in CTR Prediction

Cited by in corpus (11)

• LinRec: Linear Attention Mechanism for Long-term Sequential Recommender Systems
• M3oE: Multi-Domain Multi-Task Mixture-of Experts Recommendation Framework
• Sequential Recommendation for Optimizing Both Immediate Feedback and Long-term Retention
• Adapting Job Recommendations to User Preference Drift with Behavioral-Semantic Fusion Learning
• Efficient and Robust Regularized Federated Recommendation
• Future Impact Decomposition in Request-level Recommendations
• AutoAssign+: Automatic Shared Embedding Assignment in Streaming Recommendation
• Multi-task Offline Reinforcement Learning for Online Advertising in Recommender Systems
• Generative Archetype-Grounded Item Representations for Sequential Recommendation
• Value Function Decomposition in Markov Recommendation Process
• Masked Multi-Domain Network: Multi-Type and Multi-Scenario Conversion Rate Prediction with a Single Model