Reinforcement Learning for Strategic Recommendations
arXiv:2009.07346
Abstract
Strategic recommendations (SR) refer to the problem where an intelligent agent observes the sequential behaviors and activities of users and decides when and how to interact with them to optimize some long-term objectives, both for the user and the business. These systems are in their infancy in the industry and in need of practical solutions to some fundamental research challenges. At Adobe research, we have been implementing such systems for various use-cases, including points of interest recommendations, tutorial recommendations, next step guidance in multi-media editing software, and ad recommendation for optimizing lifetime value. There are many research challenges when building these systems, such as modeling the sequential behavior of users, deciding when to intervene and offer recommendations without annoying the user, evaluating policies offline with high confidence, safe deployment, non-stationarity, building systems from passive data that do not contain past recommendations, resource constraint optimization in multi-user systems, scaling to large and dynamic actions spaces, and handling and incorporating human cognitive biases. In this paper we cover various use-cases and research challenges we solved to make these systems practical.
References in corpus (7)
- A Contextual-Bandit Approach to Personalized News Article Recommendation
- YFCC100M: The New Data in Multimedia Research
- Near-Optimal Representation Learning for Hierarchical Reinforcement Learning
- Cumulative Prospect Theory Meets Reinforcement Learning: Prediction and Control
- Deep Reinforcement Learning with a Natural Language Action Space
- Reinforcement Learning for Slate-based Recommender Systems: A Tractable Decomposition and Practical Methodology
- The Natural Language of Actions