Unbiased Delayed Feedback Label Correction for Conversion Rate Prediction

Abstract

Conversion rate prediction is critical to many online applications such as digital display advertising. To capture dynamic data distribution, industrial systems often require retraining models on recent data daily or weekly. However, the delay of conversion behavior usually leads to incorrect labeling, which is called delayed feedback problem. Existing work may fail to introduce the correct information about false negative samples due to data sparsity and dynamic data distribution. To directly introduce the correct feedback label information, we propose an Unbiased delayed feedback Label Correction framework (ULC), which uses an auxiliary model to correct labels for observed negative feedback samples. Firstly, we theoretically prove that the label-corrected loss is an unbiased estimate of the oracle loss using true labels. Then, as there are no ready training data for label correction, counterfactual labeling is used to construct artificial training data. Furthermore, since counterfactual labeling utilizes only partial training data, we design an embedding-based alternative training method to enhance performance. Comparative experiments on both public and private datasets and detailed analyses show that our proposed approach effectively alleviates the delayed feedback problem and consistently outperforms the previous state-of-the-art methods.

arXiv commentaccepted by KDD 2023

References in corpus (8)

• AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks
• DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systems
• ESCM${}^2$: Entire Space Counterfactual Multi-Task Model for Post-Click Conversion Rate Estimation
• Enhanced Doubly Robust Learning for Debiasing Post-click Conversion Rate Estimation
• Predicting Different Types of Conversions with Multi-Task Learning in Online Advertising
• A Feedback Shift Correction in Predicting Conversion Rates under Delayed Feedback
• Follow the Prophet: Accurate Online Conversion Rate Prediction in the Face of Delayed Feedback
• Conversion Prediction Using Multi-task Conditional Attention Networks to Support the Creation of Effective Ad Creative

Cited by in corpus (1)

• Collaborative-Enhanced Prediction of Spending on Newly Downloaded Mobile Games under Consumption Uncertainty