Retrieval & Interaction Machine for Tabular Data Prediction
arXiv:2108.05252
Abstract
Prediction over tabular data is an essential task in many data science applications such as recommender systems, online advertising, medical treatment, etc. Tabular data is structured into rows and columns, with each row as a data sample and each column as a feature attribute. Both the columns and rows of the tabular data carry useful patterns that could improve the model prediction performance. However, most existing models focus on the cross-column patterns yet overlook the cross-row patterns as they deal with single samples independently. In this work, we propose a general learning framework named Retrieval & Interaction Machine (RIM) that fully exploits both cross-row and cross-column patterns among tabular data. Specifically, RIM first leverages search engine techniques to efficiently retrieve useful rows of the table to assist the label prediction of the target row, then uses feature interaction networks to capture the cross-column patterns among the target row and the retrieved rows so as to make the final label prediction. We conduct extensive experiments on 11 datasets of three important tasks, i.e., CTR prediction (classification), top-n recommendation (ranking) and rating prediction (regression). Experimental results show that RIM achieves significant improvements over the state-of-the-art and various baselines, demonstrating the superiority and efficacy of RIM.
SIGKDD 2021
References in corpus (7)
- BPR: Bayesian Personalized Ranking from Implicit Feedback
- xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems
- Recurrent Neural Networks with Top-k Gains for Session-based Recommendations
- Translation-based Recommendation
- Lifelong Sequential Modeling with Personalized Memorization for User Response Prediction
- Deep Learning over Multi-field Categorical Data: A Case Study on User Response Prediction
- Retrieval-Augmented Convolutional Neural Networks for Improved Robustness against Adversarial Examples