Real-time Attention Based Look-alike Model for Recommender System

Abstract

Recently, deep learning models play more and more important roles in contents recommender systems. However, although the performance of recommendations is greatly improved, the "Matthew effect" becomes increasingly evident. While the head contents get more and more popular, many competitive long-tail contents are difficult to achieve timely exposure because of lacking behavior features. This issue has badly impacted the quality and diversity of recommendations. To solve this problem, look-alike algorithm is a good choice to extend audience for high quality long-tail contents. But the traditional look-alike models which widely used in online advertising are not suitable for recommender systems because of the strict requirement of both real-time and effectiveness. This paper introduces a real-time attention based look-alike model (RALM) for recommender systems, which tackles the challenge of conflict between real-time and effectiveness. RALM realizes real-time look-alike audience extension benefiting from seeds-to-user similarity prediction and improves the effectiveness through optimizing user representation learning and look-alike learning modeling. For user representation learning, we propose a novel neural network structure named attention merge layer to replace the concatenation layer, which significantly improves the expressive ability of multi-fields feature learning. On the other hand, considering the various members of seeds, we design global attention unit and local attention unit to learn robust and adaptive seeds representation with respect to a certain target user. At last, we introduce seeds clustering mechanism which not only reduces the time complexity of attention units prediction but also minimizes the loss of seeds information at the same time. According to our experiments, RALM shows superior effectiveness and performance than popular look-alike models.

Accepted by KDD 2019

References in corpus (3)

• Distributed Representations of Words and Phrases and their Compositionality
• Neural Machine Translation by Jointly Learning to Align and Translate
• A Structured Self-attentive Sentence Embedding

Cited by in corpus (8)

• Causal Intervention for Leveraging Popularity Bias in Recommendation
• Towards Long-term Fairness in Recommendation
• Learning to Warm Up Cold Item Embeddings for Cold-start Recommendation with Meta Scaling and Shifting Networks
• Toward Pareto Efficient Fairness-Utility Trade-off inRecommendation through Reinforcement Learning
• Learning to Expand Audience via Meta Hybrid Experts and Critics for Recommendation and Advertising
• Towards Explainable Collaborative Filtering with Taste Clusters Learning
• Mitigating Mainstream Bias in Recommendation via Cost-sensitive Learning
• General-Purpose User Embeddings based on Mobile App Usage