Exact-K Recommendation via Maximal Clique Optimization

Abstract

This paper targets to a novel but practical recommendation problem named exact-K recommendation. It is different from traditional top-K recommendation, as it focuses more on (constrained) combinatorial optimization which will optimize to recommend a whole set of K items called card, rather than ranking optimization which assumes that "better" items should be put into top positions. Thus we take the first step to give a formal problem definition, and innovatively reduce it to Maximum Clique Optimization based on graph. To tackle this specific combinatorial optimization problem which is NP-hard, we propose Graph Attention Networks (GAttN) with a Multi-head Self-attention encoder and a decoder with attention mechanism. It can end-to-end learn the joint distribution of the K items and generate an optimal card rather than rank individual items by prediction scores. Then we propose Reinforcement Learning from Demonstrations (RLfD) which combines the advantages in behavior cloning and reinforcement learning, making it sufficient- and-efficient to train the model. Extensive experiments on three datasets demonstrate the effectiveness of our proposed GAttN with RLfD method, it outperforms several strong baselines with a relative improvement of 7.7% and 4.7% on average in Precision and Hit Ratio respectively, and achieves state-of-the-art (SOTA) performance for the exact-K recommendation problem.

SIGKDD 2019

References in corpus (10)

• Neural Machine Translation by Jointly Learning to Align and Translate
• BPR: Bayesian Personalized Ranking from Implicit Feedback
• Effective Approaches to Attention-based Neural Machine Translation
• Layer Normalization
• Order Matters: Sequence to sequence for sets
• A Multi-task Selected Learning Approach for Solving 3D Flexible Bin Packing Problem
• Beyond Greedy Ranking: Slate Optimization via List-CVAE
• Automatic Generation of Chinese Short Product Titles for Mobile Display
• Representing Verbs as Argument Concepts
• Deep Cascade Multi-task Learning for Slot Filling in Online Shopping Assistant

Cited by in corpus (2)

• Self-Supervised Reinforcement Learning for Recommender Systems
• Time-aware Gradient Attack on Dynamic Network Link Prediction