Adaptive Learning on User Segmentation: Universal to Specific Representation via Bipartite Neural Interaction

Abstract

Recently, models for user representation learning have been widely applied in click-through-rate (CTR) and conversion-rate (CVR) prediction. Usually, the model learns a universal user representation as the input for subsequent scenario-specific models. However, in numerous industrial applications (e.g., recommendation and marketing), the business always operates such applications as various online activities among different user segmentation. These segmentation are always created by domain experts. Due to the difference in user distribution (i.e., user segmentation) and business objectives in subsequent tasks, learning solely on universal representation may lead to detrimental effects on both model performance and robustness. In this paper, we propose a novel learning framework that can first learn general universal user representation through information bottleneck. Then, merge and learn a segmentation-specific or a task-specific representation through neural interaction. We design the interactive learning process by leveraging a bipartite graph architecture to model the representation learning and merging between contextual clusters and each user segmentation. Our proposed method is evaluated in two open-source benchmarks, two offline business datasets, and deployed on two online marketing applications to predict users' CVR. The results demonstrate that our method can achieve superior performance and surpass the baseline methods.

References in corpus (6)

• xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems
• AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks
• FiBiNET: Combining Feature Importance and Bilinear feature Interaction for Click-Through Rate Prediction
• Fi-GNN: Modeling Feature Interactions via Graph Neural Networks for CTR Prediction
• Click-Through Rate Prediction in Online Advertising: A Literature Review
• A Meta Reinforcement Learning Approach for Predictive Autoscaling in the Cloud

Cited by in corpus (1)

• FedSlate:A Federated Deep Reinforcement Learning Recommender System