Deep Reinforcement Learning based Recommendation with Explicit User-Item Interactions Modeling

Abstract

Recommendation is crucial in both academia and industry, and various techniques are proposed such as content-based collaborative filtering, matrix factorization, logistic regression, factorization machines, neural networks and multi-armed bandits. However, most of the previous studies suffer from two limitations: (1) considering the recommendation as a static procedure and ignoring the dynamic interactive nature between users and the recommender systems, (2) focusing on the immediate feedback of recommended items and neglecting the long-term rewards. To address the two limitations, in this paper we propose a novel recommendation framework based on deep reinforcement learning, called DRR. The DRR framework treats recommendation as a sequential decision making procedure and adopts an "Actor-Critic" reinforcement learning scheme to model the interactions between the users and recommender systems, which can consider both the dynamic adaptation and long-term rewards. Furthermore, a state representation module is incorporated into DRR, which can explicitly capture the interactions between items and users. Three instantiation structures are developed. Extensive experiments on four real-world datasets are conducted under both the offline and online evaluation settings. The experimental results demonstrate the proposed DRR method indeed outperforms the state-of-the-art competitors.

References in corpus (8)

• Continuous control with deep reinforcement learning
• Neural Architecture Search with Reinforcement Learning
• A Contextual-Bandit Approach to Personalized News Article Recommendation
• DeepFM: A Factorization-Machine based Neural Network for CTR Prediction
• Recommendations with Negative Feedback via Pairwise Deep Reinforcement Learning
• Efficient Architecture Search by Network Transformation
• Real-Time Bidding with Multi-Agent Reinforcement Learning in Display Advertising
• Deep Reinforcement Learning for List-wise Recommendations

Cited by in corpus (19)

• Fast Parallel Hypertree Decompositions in Logarithmic Recursion Depth
• Deep reinforcement learning for search, recommendation, and online advertising: a survey
• Multi-Task Recommendations with Reinforcement Learning
• A Survey of Deep Reinforcement Learning in Recommender Systems: A Systematic Review and Future Directions
• Toward Simulating Environments in Reinforcement Learning Based Recommendations
• Why People Skip Music? On Predicting Music Skips using Deep Reinforcement Learning
• AndroidEnv: A Reinforcement Learning Platform for Android
• AutoAssign+: Automatic Shared Embedding Assignment in Streaming Recommendation
• Jointly-Learned State-Action Embedding for Efficient Reinforcement Learning
• Deep Reinforcement Learning based Group Recommender System
• Balancing Accuracy and Fairness for Interactive Recommendation with Reinforcement Learning
• Towards Validating Long-Term User Feedbacks in Interactive Recommendation Systems
• Click-Through Rate Prediction Using Graph Neural Networks and Online Learning
• Deep Reinforcement Learning-Based Product Recommender for Online Advertising
• Deep Bayesian Bandits: Exploring in Online Personalized Recommendations
• D2RLIR : an improved and diversified ranking function in interactive recommendation systems based on deep reinforcement learning
• MBCAL: Sample Efficient and Variance Reduced Reinforcement Learning for Recommender Systems
• Fast Distributed Bandits for Online Recommendation Systems
• Contextual Bandits with Sparse Data in Web setting