RAMP: Robust Ad Recommendation Under Limited Personalized-Feature Availability via Masking and Alignment Pathways
arXiv:2607.17473 · doi:10.1145/3805713.3820399
Abstract
Click-through rate (CTR) and conversion rate (CVR) prediction are fundamental tasks in online advertising, aiming to estimate the likelihood of user interactions based on various features. While personalized attributes such as age and gender can significantly enhance predictive accuracy, their use is increasingly restricted by privacy regulations, thereby limiting available data for both training and inference. To address this challenge, we propose RAMP (Robust Ad Recommendation Under Limited Personalized-Feature Availability via Masking and Alignment Pathways), which is designed to improve CTR/CVR prediction accuracy when personalized features are not accessible, thus supporting deployment in privacy-constrained settings.RAMP consists of (i) a personalized pathway built upon a dual-tower component with identical inputs but independent parameters, where output masking separates predictions for personalized and non-personalized signals, (ii) a separate non-personalized pathway trained with non-personalized features only, and (iii) a distillation-inspired prediction-alignment architecture between (i) and (ii) that improves prediction when personalized features are unavailable. We conduct comprehensive experiments using both public benchmarks and industrial datasets to evaluate the performance of RAMP. Our evaluation spans multiple backbone models and different settings: with and without access to personalized features. The results show that RAMP consistently outperforms state-of-the-art methods when personalized features are missing, while maintaining competitive performance when all features are available. %demonstrating its effectiveness and practicality for real-world advertising systems. Our code is publicly available at https://github.com/Ruixinhua/RAMP.
12 pages, 4 figures, accepted to ICTIR '26
References in corpus (11)
- xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems
- AutoInt: Automatic Feature Interaction Learning via Self-Attentive Neural Networks
- DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systems
- FiBiNET: Combining Feature Importance and Bilinear feature Interaction for Click-Through Rate Prediction
- Click-Through Rate Prediction in Online Advertising: A Literature Review
- Optimized Cost per Click in Taobao Display Advertising
- DE-RRD: A Knowledge Distillation Framework for Recommender System
- Improving Efficient Neural Ranking Models with Cross-Architecture Knowledge Distillation
- EulerNet: Adaptive Feature Interaction Learning via Euler's Formula for CTR Prediction
- Practical Multi-Task Learning for Rare Conversions in Ad Tech
- FinalMLP: An Enhanced Two-Stream MLP Model for CTR Prediction