Multi-Interest Network with Dynamic Routing for Recommendation at Tmall
arXiv:1904.08030
Abstract
Industrial recommender systems usually consist of the matching stage and the ranking stage, in order to handle the billion-scale of users and items. The matching stage retrieves candidate items relevant to user interests, while the ranking stage sorts candidate items by user interests. Thus, the most critical ability is to model and represent user interests for either stage. Most of the existing deep learning-based models represent one user as a single vector which is insufficient to capture the varying nature of user's interests. In this paper, we approach this problem from a different view, to represent one user with multiple vectors encoding the different aspects of the user's interests. We propose the Multi-Interest Network with Dynamic routing (MIND) for dealing with user's diverse interests in the matching stage. Specifically, we design a multi-interest extractor layer based on capsule routing mechanism, which is applicable for clustering historical behaviors and extracting diverse interests. Furthermore, we develop a technique named label-aware attention to help learn a user representation with multiple vectors. Through extensive experiments on several public benchmarks and one large-scale industrial dataset from Tmall, we demonstrate that MIND can achieve superior performance than state-of-the-art methods for recommendation. Currently, MIND has been deployed for handling major online traffic at the homepage on Mobile Tmall App.
References in corpus (2)
Cited by in corpus (21)
- Semantic Models for the First-stage Retrieval: A Comprehensive Review
- Behavior Sequence Transformer for E-commerce Recommendation in Alibaba
- End-to-End User Behavior Retrieval in Click-Through RatePrediction Model
- Controllable Multi-Interest Framework for Recommendation
- One Model to Serve All: Star Topology Adaptive Recommender for Multi-Domain CTR Prediction
- EdgeRec: Recommender System on Edge in Mobile Taobao
- Revisit Recommender System in the Permutation Prospective
- Dynamic Memory based Attention Network for Sequential Recommendation
- Rethinking Lifelong Sequential Recommendation with Incremental Multi-Interest Attention
- Search-based User Interest Modeling with Lifelong Sequential Behavior Data for Click-Through Rate Prediction
- Exploiting Behavioral Consistence for Universal User Representation
- Towards Personalized and Semantic Retrieval: An End-to-End Solution for E-commerce Search via Embedding Learning
- Multi-Interest-Aware User Modeling for Large-Scale Sequential Recommendations
- Future-Aware Diverse Trends Framework for Recommendation
- Joint Training Capsule Network for Cold Start Recommendation
- Explore User Neighborhood for Real-time E-commerce Recommendation
- MIC: Model-agnostic Integrated Cross-channel Recommenders
- Itinerary-aware Personalized Deep Matching at Fliggy
- Cross-Batch Negative Sampling for Training Two-Tower Recommenders
- Sparse-Interest Network for Sequential Recommendation
- Path-based Deep Network for Candidate Item Matching in Recommenders